Max level shown:
1 [ Dec 21 07:47:09 Enabled. ]
2 [ Dec 21 07:47:09 Rereading configuration. ]
3 [ Dec 21 07:47:12 Rereading configuration. ]
4 [ Dec 21 07:47:21 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/omicron-nexus/bin/nexus /var/svc/manifest/site/nexus/config.toml &"). ]
5 [ Dec 21 07:47:21 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72024-12-21T07:47:21.598ZDEBGnexus: registered DTrace probes
82024-12-21T07:47:21.600ZINFOnexus: setting up nexus server file = nexus/src/lib.rs:75
92024-12-21T07:47:21.608ZINFOnexus (ServerContext): registering Oso class class = Action file = nexus/auth/src/authz/oso_generic.rs:68
102024-12-21T07:47:21.608ZINFOnexus (ServerContext): registering Oso class class = AnyActor file = nexus/auth/src/authz/oso_generic.rs:68
112024-12-21T07:47:21.608ZINFOnexus (ServerContext): registering Oso class class = AuthenticatedActor file = nexus/auth/src/authz/oso_generic.rs:68
122024-12-21T07:47:21.608ZINFOnexus (ServerContext): registering Oso class class = BlueprintConfig file = nexus/auth/src/authz/oso_generic.rs:68
132024-12-21T07:47:21.608ZINFOnexus (ServerContext): registering Oso class class = Database file = nexus/auth/src/authz/oso_generic.rs:68
142024-12-21T07:47:21.608ZINFOnexus (ServerContext): registering Oso class class = DnsConfig file = nexus/auth/src/authz/oso_generic.rs:68
152024-12-21T07:47:21.608ZINFOnexus (ServerContext): registering Oso class class = Fleet file = nexus/auth/src/authz/oso_generic.rs:68
162024-12-21T07:47:21.608ZINFOnexus (ServerContext): registering Oso class class = Inventory file = nexus/auth/src/authz/oso_generic.rs:68
172024-12-21T07:47:21.608ZINFOnexus (ServerContext): registering Oso class class = IpPoolList file = nexus/auth/src/authz/oso_generic.rs:68
182024-12-21T07:47:21.608ZINFOnexus (ServerContext): registering Oso class class = ConsoleSessionList file = nexus/auth/src/authz/oso_generic.rs:68
192024-12-21T07:47:21.608ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequestList file = nexus/auth/src/authz/oso_generic.rs:68
202024-12-21T07:47:21.608ZINFOnexus (ServerContext): registering Oso class class = SiloCertificateList file = nexus/auth/src/authz/oso_generic.rs:68
212024-12-21T07:47:21.608ZINFOnexus (ServerContext): registering Oso class class = SiloIdentityProviderList file = nexus/auth/src/authz/oso_generic.rs:68
222024-12-21T07:47:21.608ZINFOnexus (ServerContext): registering Oso class class = SiloUserList file = nexus/auth/src/authz/oso_generic.rs:68
232024-12-21T07:47:21.608ZINFOnexus (ServerContext): registering Oso class class = Project file = nexus/auth/src/authz/oso_generic.rs:68
242024-12-21T07:47:21.608ZINFOnexus (ServerContext): registering Oso class class = Disk file = nexus/auth/src/authz/oso_generic.rs:68
252024-12-21T07:47:21.608ZINFOnexus (ServerContext): registering Oso class class = Snapshot file = nexus/auth/src/authz/oso_generic.rs:68
262024-12-21T07:47:21.608ZINFOnexus (ServerContext): registering Oso class class = ProjectImage file = nexus/auth/src/authz/oso_generic.rs:68
272024-12-21T07:47:21.608ZINFOnexus (ServerContext): registering Oso class class = Instance file = nexus/auth/src/authz/oso_generic.rs:68
282024-12-21T07:47:21.608ZINFOnexus (ServerContext): registering Oso class class = IpPool file = nexus/auth/src/authz/oso_generic.rs:68
292024-12-21T07:47:21.608ZINFOnexus (ServerContext): registering Oso class class = InstanceNetworkInterface file = nexus/auth/src/authz/oso_generic.rs:68
302024-12-21T07:47:21.608ZINFOnexus (ServerContext): registering Oso class class = Vpc file = nexus/auth/src/authz/oso_generic.rs:68
312024-12-21T07:47:21.608ZINFOnexus (ServerContext): registering Oso class class = VpcRouter file = nexus/auth/src/authz/oso_generic.rs:68
322024-12-21T07:47:21.608ZINFOnexus (ServerContext): registering Oso class class = InternetGateway file = nexus/auth/src/authz/oso_generic.rs:68
332024-12-21T07:47:21.608ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpPool file = nexus/auth/src/authz/oso_generic.rs:68
342024-12-21T07:47:21.608ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpAddress file = nexus/auth/src/authz/oso_generic.rs:68
352024-12-21T07:47:21.609ZINFOnexus (ServerContext): registering Oso class class = RouterRoute file = nexus/auth/src/authz/oso_generic.rs:68
362024-12-21T07:47:21.609ZINFOnexus (ServerContext): registering Oso class class = VpcSubnet file = nexus/auth/src/authz/oso_generic.rs:68
372024-12-21T07:47:21.609ZINFOnexus (ServerContext): registering Oso class class = FloatingIp file = nexus/auth/src/authz/oso_generic.rs:68
382024-12-21T07:47:21.609ZINFOnexus (ServerContext): registering Oso class class = Image file = nexus/auth/src/authz/oso_generic.rs:68
392024-12-21T07:47:21.609ZINFOnexus (ServerContext): registering Oso class class = SiloImage file = nexus/auth/src/authz/oso_generic.rs:68
402024-12-21T07:47:21.609ZINFOnexus (ServerContext): registering Oso class class = AddressLot file = nexus/auth/src/authz/oso_generic.rs:68
412024-12-21T07:47:21.609ZINFOnexus (ServerContext): registering Oso class class = Blueprint file = nexus/auth/src/authz/oso_generic.rs:68
422024-12-21T07:47:21.609ZINFOnexus (ServerContext): registering Oso class class = LoopbackAddress file = nexus/auth/src/authz/oso_generic.rs:68
432024-12-21T07:47:21.609ZINFOnexus (ServerContext): registering Oso class class = Certificate file = nexus/auth/src/authz/oso_generic.rs:68
442024-12-21T07:47:21.609ZINFOnexus (ServerContext): registering Oso class class = ConsoleSession file = nexus/auth/src/authz/oso_generic.rs:68
452024-12-21T07:47:21.609ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequest file = nexus/auth/src/authz/oso_generic.rs:68
462024-12-21T07:47:21.609ZINFOnexus (ServerContext): registering Oso class class = DeviceAccessToken file = nexus/auth/src/authz/oso_generic.rs:68
472024-12-21T07:47:21.609ZINFOnexus (ServerContext): registering Oso class class = PhysicalDisk file = nexus/auth/src/authz/oso_generic.rs:68
482024-12-21T07:47:21.609ZINFOnexus (ServerContext): registering Oso class class = Rack file = nexus/auth/src/authz/oso_generic.rs:68
492024-12-21T07:47:21.609ZINFOnexus (ServerContext): registering Oso class class = RoleBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
502024-12-21T07:47:21.609ZINFOnexus (ServerContext): registering Oso class class = SshKey file = nexus/auth/src/authz/oso_generic.rs:68
512024-12-21T07:47:21.609ZINFOnexus (ServerContext): registering Oso class class = Silo file = nexus/auth/src/authz/oso_generic.rs:68
522024-12-21T07:47:21.609ZINFOnexus (ServerContext): registering Oso class class = SiloUser file = nexus/auth/src/authz/oso_generic.rs:68
532024-12-21T07:47:21.609ZINFOnexus (ServerContext): registering Oso class class = SiloGroup file = nexus/auth/src/authz/oso_generic.rs:68
542024-12-21T07:47:21.609ZINFOnexus (ServerContext): registering Oso class class = IdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
552024-12-21T07:47:21.609ZINFOnexus (ServerContext): registering Oso class class = SamlIdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
562024-12-21T07:47:21.609ZINFOnexus (ServerContext): registering Oso class class = Sled file = nexus/auth/src/authz/oso_generic.rs:68
572024-12-21T07:47:21.609ZINFOnexus (ServerContext): registering Oso class class = TufRepo file = nexus/auth/src/authz/oso_generic.rs:68
582024-12-21T07:47:21.609ZINFOnexus (ServerContext): registering Oso class class = TufArtifact file = nexus/auth/src/authz/oso_generic.rs:68
592024-12-21T07:47:21.609ZINFOnexus (ServerContext): registering Oso class class = Zpool file = nexus/auth/src/authz/oso_generic.rs:68
602024-12-21T07:47:21.609ZINFOnexus (ServerContext): registering Oso class class = Service file = nexus/auth/src/authz/oso_generic.rs:68
612024-12-21T07:47:21.609ZINFOnexus (ServerContext): registering Oso class class = UserBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
622024-12-21T07:47:21.609ZINFOnexus (ServerContext): full Oso configuration config = #\n# Oso configuration for Omicron\n# This file is augmented by generated snippets.\n#\n\n#\n# ACTOR TYPES AND BASIC RULES\n#\n\n# `AnyActor` includes both authenticated and unauthenticated users.\nactor AnyActor {}\n\n# An `AuthenticatedActor` has an identity in the system. All of our operations\n# today require that an actor be authenticated.\nactor AuthenticatedActor {}\n\n# For any resource, `actor` can perform action `action` on it if they're\n# authenticated and their role(s) give them the corresponding permission on that\n# resource.\nallow(actor: AnyActor, action: Action, resource) if\n actor.authenticated and\n has_permission(actor.authn_actor.unwrap(), action.to_perm(), resource);\n\n# Define role relationships\nhas_role(actor: AuthenticatedActor, role: String, resource: Resource)\n\tif resource.has_role(actor, role);\n\n#\n# ROLES AND PERMISSIONS IN THE FLEET/SILO/PROJECT HIERARCHY\n#\n# We define the following permissions for most resources in the system:\n#\n# - "create_child": required to create child resources (of any type)\n#\n# - "list_children": required to list child resources (of all types) of a\n# resource\n#\n# - "modify": required to modify or delete a resource\n#\n# - "read": required to read a resource\n#\n# We define the following predefined roles for only a few high-level resources:\n# the Fleet (see below), Silo, Organization, and Project. The specific roles\n# are oriented around intended use-cases:\n#\n# - "admin": has all permissions on the resource\n#\n# - "collaborator": has "read", "list_children", and "create_child", plus\n# the "admin" role for child resources. The idea is that if you're an\n# Organization Collaborator, you have full control over the Projects within\n# the Organization, but you cannot modify or delete the Organization itself.\n#\n# - "viewer": has "read" and "list_children" on a resource\n#\n# Below the Project level, permissions are granted via roles at the Project\n# level. For example, for someone to be able to create, modify, or delete any\n# Instances, they must be granted project.collaborator, which means they can\n# create, modify, or delete _all_ resources in the Project.\n#\n# The complete set of predefined roles:\n#\n# - fleet.admin (superuser for the whole system)\n# - fleet.collaborator (can manage Silos)\n# - fleet.viewer (can read most non-siloed resources in the system)\n# - silo.admin (superuser for the silo)\n# - silo.collaborator (can create and own Organizations)\n# - silo.viewer (can read most resources within the Silo)\n# - organization.admin (complete control over an organization)\n# - organization.collaborator (can manage Projects)\n# - organization.viewer (can read most resources within the Organization)\n# - project.admin (complete control over a Project)\n# - project.collaborator (can manage all resources within the Project)\n# - project.viewer (can read most resources within the Project)\n#\n# Outside the Silo/Organization/Project hierarchy, we (currently) treat most\n# resources as nested under Fleet or else a synthetic resource (see below). We\n# do not yet support role assignments on anything other than Fleet, Silo,\n# Organization, or Project.\n#\n\n# "Fleet" is a global singleton representing the whole system. The name comes\n# from the idea described in RFD 24, but it's not quite right. This probably\n# should be more like "Region" or "AvailabilityZone". The precise boundaries\n# have not yet been figured out.\nresource Fleet {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\troles = [\n\t # Roles that can be attached by users\n\t "admin",\n\t "collaborator",\n\t "viewer",\n\n\t # Internal-only roles\n\t "external-authenticator"\n\t];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n}\n\n# For fleets specifically, roles can be conferred by roles on the user's Silo.\nhas_role(actor: AuthenticatedActor, role: String, _: Fleet) if\n\tsilo_role in actor.confers_fleet_role(role) and\n\thas_role(actor, silo_role, actor.silo.unwrap());\n\nresource Silo {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Permissions implied by roles on this resource's parent (Fleet). Fleet\n\t# privileges allow a user to see and potentially administer the Silo,\n\t# but they do not give anyone permission to look at anything inside the\n\t# Silo. To achieve this, we use permission rules here. (If we granted\n\t# Fleet administrators _roles_ on the Silo, then those would cascade\n\t# into the Silo as well.)\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "collaborator" on "parent_fleet";\n\n\t# external authenticator has to create silo users\n\t"list_children" if "external-authenticator" on "parent_fleet";\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", silo: Silo)\n\tif silo.fleet = fleet;\n\n# As a special case, all authenticated users can read their own Silo. That's\n# not quite the same as having the "viewer" role. For example, they cannot list\n# Organizations in the Silo.\n#\n# One reason this is necessary is because if an unprivileged user tries to\n# create an Organization using "POST /organizations", they should get back a 403\n# (which implies they're able to see /organizations, which is essentially seeing\n# the Silo itself) rather than a 404. This behavior isn't a hard constraint\n# (i.e., you could reasonably get a 404 for an API you're not allowed to call).\n# Nor is the implementation (i.e., we could special-case this endpoint somehow).\n# But granting this permission is the simplest way to keep this endpoint's\n# behavior consistent with the rest of the API.\n#\n# This rule is also used to determine if a user can list the identity providers\n# in the Silo (which they should be able to), since that's predicated on being\n# able to read the Silo.\n#\n# It's unclear what else would break if users couldn't see their own Silo.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif silo in actor.silo;\n\nresource Project {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Roles implied by roles on this resource's parent (Silo)\n\trelations = { parent_silo: Silo };\n\t"admin" if "collaborator" on "parent_silo";\n\t"viewer" if "viewer" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", project: Project)\n\tif project.silo = silo;\n\n#\n# GENERAL RESOURCES OUTSIDE THE SILO/PROJECT HIERARCHY\n#\n# Many resources use snippets of Polar generated by the `authz_resource!` Rust\n# macro. Some resources require custom Polar code. Those appear here.\n#\n\nresource Certificate {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Fleet-level and silo-level roles both grant privileges on certificates.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", certificate: Certificate)\n\tif certificate.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", certificate: Certificate)\n\tif certificate.silo.fleet = fleet;\n\nresource SiloUser {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\t# Fleet and Silo administrators can manage a Silo's users. This is one\n\t# of the only areas of Silo configuration that Fleet Administrators have\n\t# permissions on.\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "read" on "parent_fleet";\n\t"read" if "read" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", user: SiloUser)\n\tif user.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", user: SiloUser)\n\tif user.silo.fleet = fleet;\n\n# authenticated actors have all permissions on themselves\nhas_permission(actor: AuthenticatedActor, _perm: String, silo_user: SiloUser)\n if actor.equals_silo_user(silo_user);\n\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if silo_user.silo in actor.silo;\n\nresource SiloGroup {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\trelations = { parent_silo: Silo };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", group: SiloGroup)\n\tif group.silo = silo;\n\nresource SshKey {\n\tpermissions = [ "read", "modify" ];\n\trelations = { silo_user: SiloUser };\n\n\t"read" if "read" on "silo_user";\n\t"modify" if "modify" on "silo_user";\n}\nhas_relation(user: SiloUser, "silo_user", ssh_key: SshKey)\n\tif ssh_key.silo_user = user;\n\nresource IdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", identity_provider: IdentityProvider)\n\tif identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: IdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource SamlIdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", saml_identity_provider: SamlIdentityProvider)\n\tif saml_identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SamlIdentityProvider)\n\tif collection.silo.fleet = fleet;\n\n#\n# SYNTHETIC RESOURCES OUTSIDE THE SILO HIERARCHY\n#\n# The resources here do not correspond to anything that appears explicitly in\n# the API or is stored in the database. These are used either at the top level\n# of the API path (e.g., "/v1/system/ip-pools") or as an implementation detail of the system\n# (in the case of console sessions and "Database"). The policies are\n# either statically-defined in this file or driven by role assignments on the\n# Fleet. None of these resources defines their own roles.\n#\n\n# Describes the policy for reading and modifying DNS configuration\n# (both internal and external)\nresource DnsConfig {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t# "external-authenticator" requires these permissions because that's the\n\t# context that Nexus uses when creating and deleting Silos. These\n\t# operations necessarily need to read and modify DNS configuration.\n\t"read" if "external-authenticator" on "parent_fleet";\n\t"modify" if "external-authenticator" on "parent_fleet";\n\t# "admin" on the parent fleet also gets these permissions, primarily for\n\t# the test suite.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", dns_config: DnsConfig)\n\tif dns_config.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource BlueprintConfig {\n\tpermissions = [\n\t "list_children", # list blueprints\n\t "create_child", # create blueprint\n\t "read", # read the current target\n\t "modify", # change the current target\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"read" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", list: BlueprintConfig)\n\tif list.fleet = fleet;\n\n# Describes the policy for reading and modifying low-level inventory\nresource Inventory {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", inventory: Inventory)\n\tif inventory.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/ip-pools" in the API\nresource IpPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the IP Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list IP Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", ip_pool_list: IpPoolList)\n\tif ip_pool_list.fleet = fleet;\n\n# Any authenticated user can create a child of a provided IP Pool.\n# This is necessary to use the pools when provisioning instances.\nhas_permission(actor: AuthenticatedActor, "create_child", ip_pool: IpPool)\n\tif silo in actor.silo and silo.fleet = ip_pool.fleet;\n\n# Describes the policy for creating and managing web console sessions.\nresource ConsoleSessionList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: ConsoleSessionList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing device authorization requests.\nresource DeviceAuthRequestList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: DeviceAuthRequestList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing Silo certificates\nresource SiloCertificateList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Both Fleet and Silo administrators can see and modify the Silo's\n\t# certificates.\n\t"list_children" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloCertificateList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloCertificateList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo identity providers\nresource SiloIdentityProviderList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the identity providers in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's identity provider\n\t# configuration. This is one of the only areas of Silo configuration\n\t# that Fleet Administrators have permissions on. This is also one of\n\t# the only cases where we need to look two levels up the hierarchy to\n\t# see if somebody has the right permission. For most other things,\n\t# permissions cascade down the hierarchy so we only need to look at the\n\t# parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloIdentityProviderList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloIdentityProviderList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo users (mostly intended for\n# API-managed users)\nresource SiloUserList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the users in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's users. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloUserList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloUserList)\n\tif collection.silo.fleet = fleet;\n\n# These rules grants the external authenticator role the permissions it needs to\n# read silo users and modify their sessions. This is necessary for login to\n# work.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif has_role(actor, "external-authenticator", silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\n\n# All authenticated users can read and delete device authn requests because\n# by necessity these operations happen before we've figured out what user (or\n# even Silo) the device auth is associated with. Any user can claim a device\n# auth request with the right user code (that's how it works) -- it's the user\n# code and associated logic that prevents unauthorized access here.\nhas_permission(_actor: AuthenticatedActor, "read", _device_auth: DeviceAuthRequest);\nhas_permission(_actor: AuthenticatedActor, "modify", _device_auth: DeviceAuthRequest);\n\nhas_permission(actor: AuthenticatedActor, "read", device_token: DeviceAccessToken)\n\tif has_role(actor, "external-authenticator", device_token.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", identity_provider: IdentityProvider)\n\tif has_role(actor, "external-authenticator", identity_provider.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", saml_identity_provider: SamlIdentityProvider)\n\tif has_role(actor, "external-authenticator", saml_identity_provider.silo.fleet);\n\n# Describes the policy for who can access the internal database.\nresource Database {\n\tpermissions = [\n\t # "query" is required to perform any query against the database,\n\t # whether a read or write query. This is checked when an operation\n\t # checks out a database connection from the connection pool.\n\t #\n\t # Any authenticated user gets this permission. There's generally\n\t # some other authz check involved in the database query. For\n\t # example, if you're querying the database to "read" a "Project", we\n\t # should also be checking that. So why do we do this at all? It's\n\t # a belt-and-suspenders measure so that if we somehow introduced an\n\t # unauthenticated code path that hits the database, it cannot be\n\t # used to DoS the database because we won't allow the operation to\n\t # make the query. (As long as the code path _is_ authenticated, we\n\t # can use throttling mechanisms to prevent DoS.)\n\t "query",\n\n\t # "modify" is required to populate database data that's delivered\n\t # with the system. It should also be required for schema changes,\n\t # when we support those. This is separate from "query" so that we\n\t # cannot accidentally invoke these code paths from API calls and\n\t # other general functions.\n\t "modify"\n\t];\n}\n\n# All authenticated users have the "query" permission on the database.\nhas_permission(_actor: AuthenticatedActor, "query", _resource: Database);\n\n# The "db-init" user is the only one with the "modify" permission.\nhas_permission(USER_DB_INIT: AuthenticatedActor, "modify", _resource: Database);\nhas_permission(USER_DB_INIT: AuthenticatedActor, "create_child", _resource: IpPoolList);\n# It also has "admin" on the internal silo to populate it with built-in resources.\n# TODO-completeness: actually limit to just internal silo and not all silos\nhas_role(USER_DB_INIT: AuthenticatedActor, "admin", _silo: Silo);\n\n# Allow the internal API admin permissions on all silos.\nhas_role(USER_INTERNAL_API: AuthenticatedActor, "admin", _silo: Silo);\n\n\n\n resource Disk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Disk)\n if child.project = parent;\n \n\n resource Snapshot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Snapshot)\n if child.project = parent;\n \n\n resource ProjectImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ProjectImage)\n if child.project = parent;\n \n\n resource Instance {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Instance)\n if child.project = parent;\n \n\n resource IpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: IpPool)\n if child.fleet = fleet;\n \n\n resource InstanceNetworkInterface {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Instance\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InstanceNetworkInterface)\n if has_relation(project, "containing_project", child.instance);\n\n has_relation(parent: Instance, "parent", child: InstanceNetworkInterface)\n if child.instance = parent;\n \n\n resource Vpc {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Vpc)\n if child.project = parent;\n \n\n resource VpcRouter {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcRouter)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcRouter)\n if child.vpc = parent;\n \n\n resource InternetGateway {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGateway)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: InternetGateway)\n if child.vpc = parent;\n \n\n resource InternetGatewayIpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpPool)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpPool)\n if child.internet_gateway = parent;\n \n\n resource InternetGatewayIpAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpAddress)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpAddress)\n if child.internet_gateway = parent;\n \n\n resource RouterRoute {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: VpcRouter\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: RouterRoute)\n if has_relation(project, "containing_project", child.vpc_router);\n\n has_relation(parent: VpcRouter, "parent", child: RouterRoute)\n if child.vpc_router = parent;\n \n\n resource VpcSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcSubnet)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcSubnet)\n if child.vpc = parent;\n \n\n resource FloatingIp {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: FloatingIp)\n if child.project = parent;\n \n\n resource Image {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: Image)\n if child.silo = parent;\n \n\n resource SiloImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: SiloImage)\n if child.silo = parent;\n \n\n resource AddressLot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AddressLot)\n if child.fleet = fleet;\n \n\n resource Blueprint {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Blueprint)\n if child.fleet = fleet;\n \n\n resource LoopbackAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: LoopbackAddress)\n if child.fleet = fleet;\n \n\n\n resource ConsoleSession {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: ConsoleSession)\n if child.fleet = fleet;\n \n\n resource DeviceAuthRequest {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAuthRequest)\n if child.fleet = fleet;\n \n\n resource DeviceAccessToken {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAccessToken)\n if child.fleet = fleet;\n \n\n resource PhysicalDisk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: PhysicalDisk)\n if child.fleet = fleet;\n \n\n resource Rack {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Rack)\n if child.fleet = fleet;\n \n\n resource RoleBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: RoleBuiltin)\n if child.fleet = fleet;\n \n\n\n\n\n\n\n\n resource Sled {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Sled)\n if child.fleet = fleet;\n \n\n resource TufRepo {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufRepo)\n if child.fleet = fleet;\n \n\n resource TufArtifact {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufArtifact)\n if child.fleet = fleet;\n \n\n resource Zpool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Zpool)\n if child.fleet = fleet;\n \n\n resource Service {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Service)\n if child.fleet = fleet;\n \n\n resource UserBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: UserBuiltin)\n if child.fleet = fleet;\n file = nexus/auth/src/authz/oso_generic.rs:89
632024-12-21T07:47:21.627ZINFOnexus (ServerContext): Setting up resolver using DNS servers for subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344::, width: 48 } } file = nexus/src/context.rs:219
642024-12-21T07:47:21.631ZINFOnexus (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
652024-12-21T07:47:21.635ZINFOnexus (ServerContext): Setting up qorb database pool from DNS dns_addrs = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = nexus/src/context.rs:275
662024-12-21T07:47:21.639ZDEBGnexus (ServerContext): registered USDT probes
672024-12-21T07:47:21.668ZINFOnexus: Database schema version is up to date desired_version = 117.0.0 file = nexus/db-queries/src/db/datastore/db_metadata.rs:145 found_version = 117.0.0
682024-12-21T07:47:21.671ZINFOnexus (SEC): SEC running file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:813 sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
692024-12-21T07:47:21.676ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 961, tv_nsec: 631743985 } })
702024-12-21T07:47:21.681ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
712024-12-21T07:47:21.729ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
722024-12-21T07:47:21.729ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
732024-12-21T07:47:21.732ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4eb6b40b-388f-4be0-839b-fdf3e77c1dfe", "content-length": "26", "date": "Sat, 21 Dec 2024 07:47:21 GMT"} })
742024-12-21T07:47:21.732ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
752024-12-21T07:47:21.732ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
762024-12-21T07:47:21.763ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 961, tv_nsec: 718038925 } })
772024-12-21T07:47:21.763ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
782024-12-21T07:47:21.797ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
792024-12-21T07:47:21.797ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
802024-12-21T07:47:21.797ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1438b43-0ba3-4218-8ee1-8f27816acf55", "content-length": "26", "date": "Sat, 21 Dec 2024 07:47:21 GMT"} })
812024-12-21T07:47:21.797ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
822024-12-21T07:47:21.798ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
832024-12-21T07:47:21.864ZDEBGnexus (clickhouse-client): registered USDT probes id = 0f295285-ff75-4de0-8c1a-8d2e505bd5d1
842024-12-21T07:47:21.872ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
852024-12-21T07:47:21.882ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
862024-12-21T07:47:21.899ZDEBGnexus (DataLoader): attempting to create built-in users
872024-12-21T07:47:21.899ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
882024-12-21T07:47:21.899ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
892024-12-21T07:47:21.908ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /artifacts/{kind}/{name}/{version} versions = all
902024-12-21T07:47:21.908ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /bgtasks versions = all
912024-12-21T07:47:21.908ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /bgtasks/activate versions = all
922024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /bgtasks/view/{bgtask_name} versions = all
932024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /clickhouse/policy versions = all
942024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /clickhouse/policy versions = all
952024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stop-request versions = all
962024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stopped versions = all
972024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair/{repair_id}/progress versions = all
982024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-finish versions = all
992024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-start versions = all
1002024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /demo-saga versions = all
1012024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /demo-saga/{demo_saga_id}/complete versions = all
1022024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/all versions = all
1032024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = DELETE path = /deployment/blueprints/all/{blueprint_id} versions = all
1042024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/all/{blueprint_id} versions = all
1052024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/import versions = all
1062024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/regenerate versions = all
1072024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/target versions = all
1082024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/target versions = all
1092024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /deployment/blueprints/target/enabled versions = all
1102024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /disk/{disk_id}/remove-read-only-parent versions = all
1112024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /disks/{disk_id} versions = all
1122024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /instances/{instance_id}/migrate versions = all
1132024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /metrics/collectors versions = all
1142024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /metrics/collectors/{collector_id}/producers versions = all
1152024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /metrics/producers versions = all
1162024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /nat/ipv4/changeset/{from_gen} versions = all
1172024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /physical-disk/expunge versions = all
1182024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /probes/{sled} versions = all
1192024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /racks/{rack_id}/initialization-complete versions = all
1202024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sagas versions = all
1212024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sagas/{saga_id} versions = all
1222024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sled-agents/{sled_id} versions = all
1232024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sled-agents/{sled_id} versions = all
1242024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sled-agents/{sled_id}/firewall-rules-update versions = all
1252024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sleds/add versions = all
1262024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sleds/expunge versions = all
1272024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sleds/uninitialized versions = all
1282024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /switch/{switch_id} versions = all
1292024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /vmms/{propolis_id} versions = all
1302024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /volume/{volume_id}/remove-read-only-parent versions = all
1312024-12-21T07:47:21.909ZINFOnexus (dropshot_internal): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::b]:12221
1322024-12-21T07:47:21.909ZDEBGnexus (dropshot_internal): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:12221
1332024-12-21T07:47:21.909ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1342024-12-21T07:47:21.910ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1352024-12-21T07:47:21.912ZWARNnexus: Cannot look up rack: Object (of type ById(5b228607-94ff-4bfc-99d8-b10385e90443)) not found: rack file = nexus/src/app/rack.rs:774
1362024-12-21T07:47:21.921ZINFOnexus (DataLoader): created 0 built-in users file = nexus/db-queries/src/db/datastore/silo_user.rs:394
1372024-12-21T07:47:21.921ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1382024-12-21T07:47:21.922ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1392024-12-21T07:47:21.922ZDEBGnexus (DataLoader): attempting to create built-in roles
1402024-12-21T07:47:21.922ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1412024-12-21T07:47:21.922ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1422024-12-21T07:47:21.938ZINFOnexus (DataLoader): created 0 built-in roles file = nexus/db-queries/src/db/datastore/role.rs:84
1432024-12-21T07:47:21.938ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1442024-12-21T07:47:21.940ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1452024-12-21T07:47:21.940ZDEBGnexus (DataLoader): attempting to create built-in role assignments
1462024-12-21T07:47:21.940ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1472024-12-21T07:47:21.940ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1482024-12-21T07:47:22.293ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:47284
1492024-12-21T07:47:22.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 5c920a48-0134-4819-a399-3a498cdeb4d4 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
1502024-12-21T07:47:22.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 5c920a48-0134-4819-a399-3a498cdeb4d4 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
1512024-12-21T07:47:22.387ZINFOnexus (DataLoader): created 0 built-in role assignments file = nexus/db-queries/src/db/datastore/role.rs:113
1522024-12-21T07:47:22.388ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1532024-12-21T07:47:22.389ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1542024-12-21T07:47:22.389ZDEBGnexus (DataLoader): attempting to create built-in silos
1552024-12-21T07:47:22.389ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1562024-12-21T07:47:22.389ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1572024-12-21T07:47:22.475ZINFOnexus (DataLoader): created 0 built-in silos file = nexus/db-queries/src/db/datastore/silo.rs:93
1582024-12-21T07:47:22.475ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1592024-12-21T07:47:22.477ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1602024-12-21T07:47:22.496ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1612024-12-21T07:47:22.498ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1622024-12-21T07:47:22.498ZDEBGnexus (DataLoader): attempting to create built-in projects
1632024-12-21T07:47:22.498ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1642024-12-21T07:47:22.498ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1652024-12-21T07:47:22.504ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1662024-12-21T07:47:22.505ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1672024-12-21T07:47:22.536ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1682024-12-21T07:47:22.536ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1692024-12-21T07:47:22.579ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1702024-12-21T07:47:22.581ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1712024-12-21T07:47:22.581ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1722024-12-21T07:47:22.581ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1732024-12-21T07:47:22.583ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1742024-12-21T07:47:22.583ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1752024-12-21T07:47:22.623ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1762024-12-21T07:47:22.625ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1772024-12-21T07:47:22.625ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1782024-12-21T07:47:22.625ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1792024-12-21T07:47:22.702ZINFOnexus (DataLoader): created built-in services project file = nexus/db-queries/src/db/datastore/project.rs:122
1802024-12-21T07:47:22.702ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1812024-12-21T07:47:22.703ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1822024-12-21T07:47:22.703ZDEBGnexus (DataLoader): attempting to create built-in VPCs
1832024-12-21T07:47:22.703ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1842024-12-21T07:47:22.703ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1852024-12-21T07:47:22.726ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1862024-12-21T07:47:22.726ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1872024-12-21T07:47:22.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 5c920a48-0134-4819-a399-3a498cdeb4d4 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
1882024-12-21T07:47:22.727ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1892024-12-21T07:47:22.728ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1902024-12-21T07:47:22.728ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 5c920a48-0134-4819-a399-3a498cdeb4d4 resource = Fleet result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
1912024-12-21T07:47:22.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 5c920a48-0134-4819-a399-3a498cdeb4d4 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
1922024-12-21T07:47:22.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 5c920a48-0134-4819-a399-3a498cdeb4d4 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
1932024-12-21T07:47:22.762ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1942024-12-21T07:47:22.762ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1952024-12-21T07:47:22.764ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1962024-12-21T07:47:22.764ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1972024-12-21T07:47:22.765ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1982024-12-21T07:47:22.767ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
1992024-12-21T07:47:22.767ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2002024-12-21T07:47:22.768ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2012024-12-21T07:47:22.769ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2022024-12-21T07:47:22.769ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2032024-12-21T07:47:22.770ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2042024-12-21T07:47:22.771ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2052024-12-21T07:47:22.772ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2062024-12-21T07:47:22.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 5c920a48-0134-4819-a399-3a498cdeb4d4 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
2072024-12-21T07:47:22.774ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2082024-12-21T07:47:22.774ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2092024-12-21T07:47:22.775ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2102024-12-21T07:47:22.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 5c920a48-0134-4819-a399-3a498cdeb4d4 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
2112024-12-21T07:47:22.792ZINFOnexus (dropshot_internal): set cockroachdb setting actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/cockroachdb_settings.rs:124 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 5c920a48-0134-4819-a399-3a498cdeb4d4 setting = cluster.preserve_downgrade_option uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete value = 22.1
2122024-12-21T07:47:22.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 5c920a48-0134-4819-a399-3a498cdeb4d4 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
2132024-12-21T07:47:22.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 5c920a48-0134-4819-a399-3a498cdeb4d4 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
2142024-12-21T07:47:22.794ZINFOnexus (dropshot_internal): request completed error_message_external = not found: rack with id "5b228607-94ff-4bfc-99d8-b10385e90443" error_message_internal = not found: rack with id "5b228607-94ff-4bfc-99d8-b10385e90443" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 501306 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 5c920a48-0134-4819-a399-3a498cdeb4d4 response_code = 404 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
2152024-12-21T07:47:22.826ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2162024-12-21T07:47:22.826ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2172024-12-21T07:47:22.827ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2182024-12-21T07:47:22.827ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2192024-12-21T07:47:22.829ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2202024-12-21T07:47:22.829ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2212024-12-21T07:47:22.830ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2222024-12-21T07:47:22.833ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
2232024-12-21T07:47:22.833ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2242024-12-21T07:47:22.833ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2252024-12-21T07:47:22.862ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2262024-12-21T07:47:22.862ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2272024-12-21T07:47:22.878ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2282024-12-21T07:47:22.878ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2292024-12-21T07:47:22.905ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2302024-12-21T07:47:22.906ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2312024-12-21T07:47:22.911ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2322024-12-21T07:47:22.912ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2332024-12-21T07:47:22.924ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2342024-12-21T07:47:22.924ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2352024-12-21T07:47:22.926ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2362024-12-21T07:47:22.926ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2372024-12-21T07:47:22.928ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2382024-12-21T07:47:22.928ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2392024-12-21T07:47:22.929ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2402024-12-21T07:47:22.932ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2412024-12-21T07:47:22.932ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2422024-12-21T07:47:22.932ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2432024-12-21T07:47:22.933ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2442024-12-21T07:47:22.934ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2452024-12-21T07:47:22.935ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2462024-12-21T07:47:22.935ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2472024-12-21T07:47:22.936ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2482024-12-21T07:47:22.940ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2492024-12-21T07:47:22.940ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2502024-12-21T07:47:22.940ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2512024-12-21T07:47:22.993ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2522024-12-21T07:47:22.993ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2532024-12-21T07:47:22.994ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2542024-12-21T07:47:22.994ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2552024-12-21T07:47:22.996ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2562024-12-21T07:47:22.996ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2572024-12-21T07:47:22.997ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2582024-12-21T07:47:23.000ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2592024-12-21T07:47:23.000ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2602024-12-21T07:47:23.000ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2612024-12-21T07:47:23.036ZDEBGnexus (DataLoader): attempting to create built-in VPC firewall rules
2622024-12-21T07:47:23.036ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2632024-12-21T07:47:23.037ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2642024-12-21T07:47:23.039ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2652024-12-21T07:47:23.039ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2662024-12-21T07:47:23.040ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2672024-12-21T07:47:23.040ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2682024-12-21T07:47:23.042ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2692024-12-21T07:47:23.042ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2702024-12-21T07:47:23.043ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2712024-12-21T07:47:23.043ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2722024-12-21T07:47:23.044ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2732024-12-21T07:47:23.045ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2742024-12-21T07:47:23.046ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2752024-12-21T07:47:23.048ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2762024-12-21T07:47:23.048ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2772024-12-21T07:47:23.049ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2782024-12-21T07:47:23.050ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2792024-12-21T07:47:23.050ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2802024-12-21T07:47:23.052ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2812024-12-21T07:47:23.052ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2822024-12-21T07:47:23.055ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2832024-12-21T07:47:23.058ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2842024-12-21T07:47:23.058ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2852024-12-21T07:47:23.058ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2862024-12-21T07:47:23.062ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2872024-12-21T07:47:23.062ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2882024-12-21T07:47:23.064ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2892024-12-21T07:47:23.064ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2902024-12-21T07:47:23.065ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2912024-12-21T07:47:23.065ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2922024-12-21T07:47:23.066ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2932024-12-21T07:47:23.069ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2942024-12-21T07:47:23.069ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2952024-12-21T07:47:23.069ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2962024-12-21T07:47:23.146ZWARNnexus (datastore): Retryable transaction failure file = nexus/db-queries/src/transaction_retry.rs:165 retry_after (ms) = 6 transaction = vpc_update_firewall_rules
2972024-12-21T07:47:23.178ZINFOnexus (datastore): transaction completed attempts = 2 file = nexus/db-queries/src/transaction_retry.rs:121 transaction = vpc_update_firewall_rules
2982024-12-21T07:47:23.178ZINFOnexus (DataLoader): created built-in VPC firewall rules file = nexus/db-queries/src/db/datastore/vpc.rs:282
2992024-12-21T07:47:23.178ZDEBGnexus (DataLoader): attempting to create built-in VPC Subnets
3002024-12-21T07:47:23.178ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3012024-12-21T07:47:23.178ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3022024-12-21T07:47:23.186ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3032024-12-21T07:47:23.186ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3042024-12-21T07:47:23.188ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3052024-12-21T07:47:23.189ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3062024-12-21T07:47:23.190ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3072024-12-21T07:47:23.190ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3082024-12-21T07:47:23.192ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3092024-12-21T07:47:23.192ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3102024-12-21T07:47:23.193ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3112024-12-21T07:47:23.193ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3122024-12-21T07:47:23.194ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3132024-12-21T07:47:23.197ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3142024-12-21T07:47:23.197ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3152024-12-21T07:47:23.198ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3162024-12-21T07:47:23.206ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3172024-12-21T07:47:23.206ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:44651
3182024-12-21T07:47:23.207ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3192024-12-21T07:47:23.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44651 req_id = 3e083596-7e8b-4df7-875d-1ed091096dcb roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
3202024-12-21T07:47:23.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44651 req_id = 3e083596-7e8b-4df7-875d-1ed091096dcb resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
3212024-12-21T07:47:23.208ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3222024-12-21T07:47:23.208ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3232024-12-21T07:47:23.210ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3242024-12-21T07:47:23.210ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3252024-12-21T07:47:23.211ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3262024-12-21T07:47:23.212ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3272024-12-21T07:47:23.213ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3282024-12-21T07:47:23.213ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3292024-12-21T07:47:23.214ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3302024-12-21T07:47:23.214ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3312024-12-21T07:47:23.216ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3322024-12-21T07:47:23.219ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ById(001de000-c470-4000-8000-000000000001) } result = Ok(())
3332024-12-21T07:47:23.219ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3342024-12-21T07:47:23.219ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3352024-12-21T07:47:23.235ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3362024-12-21T07:47:23.236ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3372024-12-21T07:47:23.238ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3382024-12-21T07:47:23.238ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3392024-12-21T07:47:23.239ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3402024-12-21T07:47:23.240ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3412024-12-21T07:47:23.241ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3422024-12-21T07:47:23.244ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3432024-12-21T07:47:23.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45824 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44651 req_id = 3e083596-7e8b-4df7-875d-1ed091096dcb response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
3442024-12-21T07:47:23.257ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3452024-12-21T07:47:23.258ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3462024-12-21T07:47:23.320ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3472024-12-21T07:47:23.321ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3482024-12-21T07:47:23.325ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3492024-12-21T07:47:23.325ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3502024-12-21T07:47:23.356ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3512024-12-21T07:47:23.356ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3522024-12-21T07:47:23.362ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3532024-12-21T07:47:23.362ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3542024-12-21T07:47:23.399ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3552024-12-21T07:47:23.402ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3562024-12-21T07:47:23.402ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3572024-12-21T07:47:23.403ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3582024-12-21T07:47:23.409ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3592024-12-21T07:47:23.410ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3602024-12-21T07:47:23.418ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3612024-12-21T07:47:23.418ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3622024-12-21T07:47:23.419ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3632024-12-21T07:47:23.420ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3642024-12-21T07:47:23.421ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3652024-12-21T07:47:23.421ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3662024-12-21T07:47:23.423ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3672024-12-21T07:47:23.423ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3682024-12-21T07:47:23.424ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3692024-12-21T07:47:23.424ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3702024-12-21T07:47:23.425ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3712024-12-21T07:47:23.426ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3722024-12-21T07:47:23.427ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3732024-12-21T07:47:23.430ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000003, lookup_type: ById(001de000-c470-4000-8000-000000000003) } result = Ok(())
3742024-12-21T07:47:23.430ZINFOnexus (DataLoader): created built-in services vpc subnets file = nexus/db-queries/src/db/datastore/vpc.rs:346
3752024-12-21T07:47:23.430ZINFOnexus (DataLoader): created built-in services vpc file = nexus/db-queries/src/db/datastore/vpc.rs:224
3762024-12-21T07:47:23.430ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3772024-12-21T07:47:23.431ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3782024-12-21T07:47:23.431ZDEBGnexus (DataLoader): attempting to create silo users
3792024-12-21T07:47:23.431ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3802024-12-21T07:47:23.431ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3812024-12-21T07:47:23.439ZINFOnexus (DataLoader): created 0 silo users file = nexus/db-queries/src/db/datastore/silo_user.rs:419
3822024-12-21T07:47:23.439ZDEBGnexus (DataLoader): attempting to create silo user role assignments
3832024-12-21T07:47:23.439ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3842024-12-21T07:47:23.439ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3852024-12-21T07:47:23.441ZINFOnexus (DataLoader): created 0 silo user role assignments file = nexus/db-queries/src/db/datastore/silo_user.rs:446
3862024-12-21T07:47:23.441ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3872024-12-21T07:47:23.441ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3882024-12-21T07:47:23.449ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3892024-12-21T07:47:23.450ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3902024-12-21T07:47:23.465ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3912024-12-21T07:47:23.465ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3922024-12-21T07:47:23.466ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3932024-12-21T07:47:23.467ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = IpPoolList result = Ok(())
3942024-12-21T07:47:23.467ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3952024-12-21T07:47:23.467ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3962024-12-21T07:47:23.497ZINFOnexus: populate complete file = nexus/src/app/mod.rs:527
3972024-12-21T07:47:23.497ZINFOnexus: activating background tasks file = nexus/src/app/mod.rs:536
3982024-12-21T07:47:23.501ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 1 reason = Timeout
3992024-12-21T07:47:23.501ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4002024-12-21T07:47:23.501ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4012024-12-21T07:47:23.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4022024-12-21T07:47:23.502ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 1 reason = Timeout
4032024-12-21T07:47:23.502ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 1 reason = Timeout
4042024-12-21T07:47:23.502ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 1 reason = Timeout
4052024-12-21T07:47:23.502ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4062024-12-21T07:47:23.502ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 1 reason = Timeout
4072024-12-21T07:47:23.502ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4082024-12-21T07:47:23.502ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 1 reason = Timeout
4092024-12-21T07:47:23.502ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 1 reason = Timeout
4102024-12-21T07:47:23.502ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 1 reason = Timeout
4112024-12-21T07:47:23.502ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
4122024-12-21T07:47:23.502ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4132024-12-21T07:47:23.502ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
4142024-12-21T07:47:23.502ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4152024-12-21T07:47:23.502ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4162024-12-21T07:47:23.502ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
4172024-12-21T07:47:23.503ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 1 reason = Timeout
4182024-12-21T07:47:23.503ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 1 reason = Timeout
4192024-12-21T07:47:23.503ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 1 reason = Timeout
4202024-12-21T07:47:23.503ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 1 reason = Timeout
4212024-12-21T07:47:23.503ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 1 reason = Timeout
4222024-12-21T07:47:23.503ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4232024-12-21T07:47:23.503ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 1 reason = Timeout
4242024-12-21T07:47:23.503ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4252024-12-21T07:47:23.503ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
4262024-12-21T07:47:23.503ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4272024-12-21T07:47:23.503ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 1 reason = Timeout
4282024-12-21T07:47:23.503ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = crdb_node_id_collector file = nexus/src/app/background/tasks/crdb_node_id_collector.rs:78 reason = no blueprint
4292024-12-21T07:47:23.503ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 1 reason = Timeout
4302024-12-21T07:47:23.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
4312024-12-21T07:47:23.503ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 1 reason = Timeout
4322024-12-21T07:47:23.503ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 1 reason = Timeout
4332024-12-21T07:47:23.503ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 118.902\u{b5}s iteration = 1 status = {"error":"no blueprint"}
4342024-12-21T07:47:23.503ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4352024-12-21T07:47:23.503ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4362024-12-21T07:47:23.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4372024-12-21T07:47:23.504ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4382024-12-21T07:47:23.504ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4392024-12-21T07:47:23.504ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 1 reason = Timeout
4402024-12-21T07:47:23.504ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 1 reason = Timeout
4412024-12-21T07:47:23.504ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4422024-12-21T07:47:23.504ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
4432024-12-21T07:47:23.504ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 1 reason = Timeout
4442024-12-21T07:47:23.504ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 823.404\u{b5}s iteration = 1 status = {"error":"no config nor servers"}
4452024-12-21T07:47:23.504ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 1 reason = Timeout
4462024-12-21T07:47:23.504ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
4472024-12-21T07:47:23.504ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 886.695\u{b5}s iteration = 1 status = {"error":"no config nor servers"}
4482024-12-21T07:47:23.504ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 1 reason = Timeout
4492024-12-21T07:47:23.504ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
4502024-12-21T07:47:23.504ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 1 reason = Timeout
4512024-12-21T07:47:23.504ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 1 reason = Timeout
4522024-12-21T07:47:23.504ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 1 reason = Timeout
4532024-12-21T07:47:23.504ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 1 reason = Timeout
4542024-12-21T07:47:23.504ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
4552024-12-21T07:47:23.504ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 1 reason = Timeout
4562024-12-21T07:47:23.504ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
4572024-12-21T07:47:23.504ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4582024-12-21T07:47:23.504ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
4592024-12-21T07:47:23.504ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4602024-12-21T07:47:23.504ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 1 reason = Timeout
4612024-12-21T07:47:23.504ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
4622024-12-21T07:47:23.504ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 1 reason = Timeout
4632024-12-21T07:47:23.504ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:74 reason = no blueprint
4642024-12-21T07:47:23.505ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 1.640488ms iteration = 1 status = {"error":"no blueprint"}
4652024-12-21T07:47:23.505ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4662024-12-21T07:47:23.506ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("481de7e8-0737-474b-8c33-e6e8bc6477be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("683a9892-43cd-4dd8-a983-26cccd988df0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 963, tv_nsec: 459945542 } })
4672024-12-21T07:47:23.506ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1595c632-cfae-4f6b-937d-d413dd8cf0b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 963, tv_nsec: 460064914 } })
4682024-12-21T07:47:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
4692024-12-21T07:47:23.507ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4702024-12-21T07:47:23.508ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 1 reason = Timeout
4712024-12-21T07:47:23.508ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
4722024-12-21T07:47:23.508ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4732024-12-21T07:47:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
4742024-12-21T07:47:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4752024-12-21T07:47:23.509ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 1 reason = Timeout
4762024-12-21T07:47:23.509ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 1 reason = Timeout
4772024-12-21T07:47:23.509ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4782024-12-21T07:47:23.509ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:37:23.509539998 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
4792024-12-21T07:47:23.509ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4802024-12-21T07:47:23.509ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
4812024-12-21T07:47:23.509ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4822024-12-21T07:47:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4832024-12-21T07:47:23.509ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal dns_group = internal file = nexus/src/app/background/tasks/dns_servers.rs:113
4842024-12-21T07:47:23.509ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 6.541922ms iteration = 1 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
4852024-12-21T07:47:23.509ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4862024-12-21T07:47:23.509ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 2 reason = Dependency
4872024-12-21T07:47:23.509ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
4882024-12-21T07:47:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
4892024-12-21T07:47:23.509ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 5.68\u{b5}s iteration = 2 status = {"error":"no config"}
4902024-12-21T07:47:23.509ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 1 reason = Timeout
4912024-12-21T07:47:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4922024-12-21T07:47:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
4932024-12-21T07:47:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
4942024-12-21T07:47:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4952024-12-21T07:47:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4962024-12-21T07:47:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4972024-12-21T07:47:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4982024-12-21T07:47:23.509ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external dns_group = external file = nexus/src/app/background/tasks/dns_servers.rs:113
4992024-12-21T07:47:23.509ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 6.455751ms iteration = 1 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
5002024-12-21T07:47:23.509ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 2 reason = Dependency
5012024-12-21T07:47:23.509ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
5022024-12-21T07:47:23.510ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 3.2\u{b5}s iteration = 2 status = {"error":"no config"}
5032024-12-21T07:47:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
5042024-12-21T07:47:23.510ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5052024-12-21T07:47:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
5062024-12-21T07:47:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5072024-12-21T07:47:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5082024-12-21T07:47:23.510ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5092024-12-21T07:47:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5102024-12-21T07:47:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5112024-12-21T07:47:23.511ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
5122024-12-21T07:47:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5132024-12-21T07:47:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5142024-12-21T07:47:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5152024-12-21T07:47:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5162024-12-21T07:47:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5172024-12-21T07:47:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5182024-12-21T07:47:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
5192024-12-21T07:47:23.514ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5202024-12-21T07:47:23.514ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5212024-12-21T07:47:23.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5222024-12-21T07:47:23.531ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5232024-12-21T07:47:23.534ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
5242024-12-21T07:47:23.534ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
5252024-12-21T07:47:23.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5262024-12-21T07:47:23.534ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 963, tv_nsec: 489570310 } })
5272024-12-21T07:47:23.535ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
5282024-12-21T07:47:23.542ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5292024-12-21T07:47:23.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5302024-12-21T07:47:23.547ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5312024-12-21T07:47:23.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5322024-12-21T07:47:23.551ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5332024-12-21T07:47:23.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5342024-12-21T07:47:23.562ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5352024-12-21T07:47:23.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
5362024-12-21T07:47:23.582ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5372024-12-21T07:47:23.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5382024-12-21T07:47:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5392024-12-21T07:47:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
5402024-12-21T07:47:23.585ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5412024-12-21T07:47:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5422024-12-21T07:47:23.586ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
5432024-12-21T07:47:23.586ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5442024-12-21T07:47:23.586ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "38dc9d7b-2d77-4dd4-a213-db70ed1b4a48", "content-length": "26", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
5452024-12-21T07:47:23.586ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5462024-12-21T07:47:23.586ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 84.116992ms iteration = 1 status = {"errors":[],"garbage_collect_requested":[]}
5472024-12-21T07:47:23.588ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5482024-12-21T07:47:23.595ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 91.695773ms iteration = 1 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5492024-12-21T07:47:23.611ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5502024-12-21T07:47:23.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5512024-12-21T07:47:23.614ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5522024-12-21T07:47:23.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5532024-12-21T07:47:23.622ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5542024-12-21T07:47:23.624ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 963, tv_nsec: 578809851 } })
5552024-12-21T07:47:23.624ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
5562024-12-21T07:47:23.625ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 122.218137ms iteration = 1 status = {"errors":[],"finish_invoked_ok":[]}
5572024-12-21T07:47:23.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5582024-12-21T07:47:23.626ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5592024-12-21T07:47:23.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5602024-12-21T07:47:23.628ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5612024-12-21T07:47:23.629ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:37:23.509539998 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5622024-12-21T07:47:23.629ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 126.031372ms iteration = 1 status = {"expiration":"2024-12-21T07:37:23.509539998Z","pruned":[]}
5632024-12-21T07:47:23.629ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5642024-12-21T07:47:23.630ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5652024-12-21T07:47:23.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5662024-12-21T07:47:23.631ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5672024-12-21T07:47:23.631ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5682024-12-21T07:47:23.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5692024-12-21T07:47:23.633ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
5702024-12-21T07:47:23.633ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5712024-12-21T07:47:23.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5722024-12-21T07:47:23.641ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5732024-12-21T07:47:23.641ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 138.313653ms iteration = 1 status = {"errors":[],"found_port_ok":[]}
5742024-12-21T07:47:23.644ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 140.830776ms iteration = 1 status = {}
5752024-12-21T07:47:23.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
5762024-12-21T07:47:23.650ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5772024-12-21T07:47:23.650ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5782024-12-21T07:47:23.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5792024-12-21T07:47:23.650ZWARNnexus (BackgroundTasks): inventory collection is None background_task = service_zone_nat_tracker file = nexus/src/app/background/tasks/sync_service_zone_nat.rs:95
5802024-12-21T07:47:23.650ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 147.923207ms iteration = 1 status = {"error":"inventory collection is None"}
5812024-12-21T07:47:23.651ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5822024-12-21T07:47:23.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5832024-12-21T07:47:23.654ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5842024-12-21T07:47:23.655ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5852024-12-21T07:47:23.655ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5862024-12-21T07:47:23.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5872024-12-21T07:47:23.656ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5882024-12-21T07:47:23.656ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5892024-12-21T07:47:23.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5902024-12-21T07:47:23.672ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
5912024-12-21T07:47:23.672ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 169.525038ms iteration = 1 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
5922024-12-21T07:47:23.680ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5932024-12-21T07:47:23.685ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
5942024-12-21T07:47:23.685ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5952024-12-21T07:47:23.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5962024-12-21T07:47:23.689ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:80 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
5972024-12-21T07:47:23.689ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 185.822967ms iteration = 1 status = {"error":"rack not yet initialized: 5b228607-94ff-4bfc-99d8-b10385e90443"}
5982024-12-21T07:47:23.689ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 186.646992ms iteration = 1 status = {}
5992024-12-21T07:47:23.691ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
6002024-12-21T07:47:23.691ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6012024-12-21T07:47:23.691ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1319a6d-4f53-431c-90a1-2ee40af760cd", "content-length": "26", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6022024-12-21T07:47:23.691ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6032024-12-21T07:47:23.692ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6042024-12-21T07:47:23.707ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6052024-12-21T07:47:23.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6062024-12-21T07:47:23.729ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_internal dns_group = internal error = Internal Error: expected exactly one latest version for DNS group Internal, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
6072024-12-21T07:47:23.729ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 228.198234ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group Internal, found 0"}
6082024-12-21T07:47:23.731ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
6092024-12-21T07:47:23.731ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 227.96369ms iteration = 1 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
6102024-12-21T07:47:23.731ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
6112024-12-21T07:47:23.731ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
6122024-12-21T07:47:23.731ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 228.355597ms iteration = 1 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
6132024-12-21T07:47:23.733ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_external dns_group = external error = Internal Error: expected exactly one latest version for DNS group External, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
6142024-12-21T07:47:23.733ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 231.090854ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group External, found 0"}
6152024-12-21T07:47:23.736ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6162024-12-21T07:47:23.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6172024-12-21T07:47:23.737ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6182024-12-21T07:47:23.737ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
6192024-12-21T07:47:23.737ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6202024-12-21T07:47:23.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6212024-12-21T07:47:23.739ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6222024-12-21T07:47:23.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6232024-12-21T07:47:23.742ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
6242024-12-21T07:47:23.743ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3cea2423-3ccb-43bb-863c-f67d90e38617", "content-length": "1", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6252024-12-21T07:47:23.743ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6262024-12-21T07:47:23.745ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6272024-12-21T07:47:23.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6282024-12-21T07:47:23.745ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = []
6292024-12-21T07:47:23.746ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 963, tv_nsec: 701107379 } })
6302024-12-21T07:47:23.749ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6312024-12-21T07:47:23.749ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6322024-12-21T07:47:23.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6332024-12-21T07:47:23.761ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6342024-12-21T07:47:23.761ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 258.458804ms iteration = 1 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6352024-12-21T07:47:23.761ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
6362024-12-21T07:47:23.761ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
6372024-12-21T07:47:23.761ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 258.449323ms iteration = 1 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
6382024-12-21T07:47:23.762ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 259.207926ms iteration = 1 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6392024-12-21T07:47:23.767ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6402024-12-21T07:47:23.767ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6412024-12-21T07:47:23.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6422024-12-21T07:47:23.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6432024-12-21T07:47:23.770ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 266.729295ms iteration = 1 status = null
6442024-12-21T07:47:23.771ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6452024-12-21T07:47:23.771ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 268.21146ms iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6462024-12-21T07:47:23.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6472024-12-21T07:47:23.779ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6482024-12-21T07:47:23.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6492024-12-21T07:47:23.782ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6502024-12-21T07:47:23.785ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
6512024-12-21T07:47:23.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
6522024-12-21T07:47:23.788ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6532024-12-21T07:47:23.788ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6542024-12-21T07:47:23.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6552024-12-21T07:47:23.794ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
6562024-12-21T07:47:23.794ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
6572024-12-21T07:47:23.794ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
6582024-12-21T07:47:23.795ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "cbb8ed4a-8eed-4df6-9b65-2ae8c94c592e", "content-length": "476", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6592024-12-21T07:47:23.795ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
6602024-12-21T07:47:23.796ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc58f076-6a47-4c85-bc2e-442376194080", "content-length": "734", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6612024-12-21T07:47:23.797ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
6622024-12-21T07:47:23.798ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f99bc44-9ad1-4115-be75-9671f1f8cc7e", "content-length": "111", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6632024-12-21T07:47:23.799ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
6642024-12-21T07:47:23.799ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e0d5210-8bb0-4e5d-9fb3-a843e022f83b", "content-length": "111", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6652024-12-21T07:47:23.799ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
6662024-12-21T07:47:23.799ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "258af278-6f2f-4592-a86c-97ac78af3626", "content-length": "167", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6672024-12-21T07:47:23.799ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
6682024-12-21T07:47:23.804ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "bfa743a7-2060-46ea-bbe9-1a5660028d36", "content-length": "167", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6692024-12-21T07:47:23.804ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
6702024-12-21T07:47:23.804ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2b2d250-2cdd-4b83-a530-954d1053393a", "content-length": "175", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6712024-12-21T07:47:23.804ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
6722024-12-21T07:47:23.805ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6732024-12-21T07:47:23.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6742024-12-21T07:47:23.809ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6752024-12-21T07:47:23.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6762024-12-21T07:47:23.810ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "62d446b4-cb30-477a-b4fc-295e53ec2620", "content-length": "175", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6772024-12-21T07:47:23.811ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
6782024-12-21T07:47:23.811ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d38409cf-44e7-4482-b561-e007354d35b2", "content-length": "702", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6792024-12-21T07:47:23.811ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6802024-12-21T07:47:23.812ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "dbc9ef7d-2a09-4a67-a6c3-d49a36aeee25", "content-length": "727", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6812024-12-21T07:47:23.812ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6822024-12-21T07:47:23.812ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6832024-12-21T07:47:23.812ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "757dea51-c597-43ab-8f0e-99e66748694a", "content-length": "729", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6842024-12-21T07:47:23.812ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6852024-12-21T07:47:23.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6862024-12-21T07:47:23.812ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "cfe1e383-a474-468a-9957-ada1c0384b5c", "content-length": "728", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6872024-12-21T07:47:23.812ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
6882024-12-21T07:47:23.813ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e3eb8cf-a33b-46e7-b0e6-0abaca191aaa", "content-length": "722", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6892024-12-21T07:47:23.813ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
6902024-12-21T07:47:23.813ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9122a8a9-b890-4864-b366-20189e992b89", "content-length": "109", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6912024-12-21T07:47:23.813ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
6922024-12-21T07:47:23.814ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "22eba339-e7da-4c93-a8ab-101da5602ebb", "content-length": "109", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6932024-12-21T07:47:23.814ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
6942024-12-21T07:47:23.814ZWARNnexus (BackgroundTasks): failed to read Silo/DNS/TLS configuration background_task = external_endpoints error = Internal Error: expected at least one external DNS zone file = nexus/src/app/background/tasks/external_endpoints.rs:48
6952024-12-21T07:47:23.814ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 311.37051ms iteration = 1 status = {"error":"failed to read Silo/DNS/TLS configuration: Internal Error: expected at least one external DNS zone"}
6962024-12-21T07:47:23.814ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e582bac-f205-40b6-acb2-d9e2681adc85", "content-length": "169", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
6972024-12-21T07:47:23.814ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
6982024-12-21T07:47:23.815ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6992024-12-21T07:47:23.815ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b92ab98a-5d53-4e80-b5be-e78ffa02689a", "content-length": "169", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
7002024-12-21T07:47:23.815ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
7012024-12-21T07:47:23.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7022024-12-21T07:47:23.815ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e6faff63-7df6-4c51-bb6c-168b3821c077", "content-length": "178", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
7032024-12-21T07:47:23.815ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
7042024-12-21T07:47:23.816ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e82a3729-bb5c-40d2-8a06-0fabc54764db", "content-length": "178", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
7052024-12-21T07:47:23.816ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
7062024-12-21T07:47:23.816ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "02a1277c-e019-45d1-817c-ab3e95a4ff51", "content-length": "702", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
7072024-12-21T07:47:23.816ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7082024-12-21T07:47:23.816ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c041274e-5b95-43cb-8984-c4dc5bb86667", "content-length": "727", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
7092024-12-21T07:47:23.816ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7102024-12-21T07:47:23.817ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9c0793d-c687-4ec8-badc-24d449dc1e1b", "content-length": "729", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
7112024-12-21T07:47:23.817ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7122024-12-21T07:47:23.817ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2835d04d-80c9-48a0-97b2-50171e07d6bc", "content-length": "728", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
7132024-12-21T07:47:23.817ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7142024-12-21T07:47:23.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7152024-12-21T07:47:23.817ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7162024-12-21T07:47:23.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7172024-12-21T07:47:23.819ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7182024-12-21T07:47:23.819ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7192024-12-21T07:47:23.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7202024-12-21T07:47:23.821ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7212024-12-21T07:47:23.821ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7222024-12-21T07:47:23.821ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
7232024-12-21T07:47:23.821ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7242024-12-21T07:47:23.822ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7252024-12-21T07:47:23.822ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7262024-12-21T07:47:23.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7272024-12-21T07:47:23.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7282024-12-21T07:47:23.824ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7292024-12-21T07:47:23.827ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7302024-12-21T07:47:23.827ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7312024-12-21T07:47:23.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
7322024-12-21T07:47:23.827ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7332024-12-21T07:47:23.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7342024-12-21T07:47:23.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7352024-12-21T07:47:23.829ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7362024-12-21T07:47:23.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7372024-12-21T07:47:23.831ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7382024-12-21T07:47:23.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7392024-12-21T07:47:23.835ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7402024-12-21T07:47:23.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7412024-12-21T07:47:23.837ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7422024-12-21T07:47:23.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7432024-12-21T07:47:23.839ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7442024-12-21T07:47:23.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7452024-12-21T07:47:23.845ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7462024-12-21T07:47:23.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7472024-12-21T07:47:23.847ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7482024-12-21T07:47:23.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7492024-12-21T07:47:23.851ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7502024-12-21T07:47:23.855ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
7512024-12-21T07:47:23.855ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7522024-12-21T07:47:23.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7532024-12-21T07:47:23.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 353.206617ms iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7542024-12-21T07:47:23.858ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7552024-12-21T07:47:23.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7562024-12-21T07:47:23.860ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7572024-12-21T07:47:23.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7582024-12-21T07:47:23.892ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7592024-12-21T07:47:23.892ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7602024-12-21T07:47:23.892ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 389.360728ms iteration = 1 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7612024-12-21T07:47:23.907ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7622024-12-21T07:47:23.909ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7632024-12-21T07:47:23.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7642024-12-21T07:47:23.910ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
7652024-12-21T07:47:23.910ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7662024-12-21T07:47:23.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7672024-12-21T07:47:23.912ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 409.390891ms iteration = 1 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
7682024-12-21T07:47:23.913ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
7692024-12-21T07:47:23.914ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
7702024-12-21T07:47:23.915ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
7712024-12-21T07:47:23.916ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
7722024-12-21T07:47:23.918ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7732024-12-21T07:47:23.921ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5b228607-94ff-4bfc-99d8-b10385e90443, lookup_type: ById(5b228607-94ff-4bfc-99d8-b10385e90443) } result = Ok(())
7742024-12-21T07:47:23.921ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 5b228607-94ff-4bfc-99d8-b10385e90443, time_created: 2024-12-21T07:47:23.391125Z, time_modified: 2024-12-21T07:47:23.391125Z }, initialized: false, tuf_base_url: None, rack_subnet: None } file = nexus/src/app/rack.rs:768
7752024-12-21T07:47:23.930ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7762024-12-21T07:47:23.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7772024-12-21T07:47:23.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
7782024-12-21T07:47:23.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
7792024-12-21T07:47:23.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
7802024-12-21T07:47:23.935ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7812024-12-21T07:47:23.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7822024-12-21T07:47:23.936ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Fleet result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
7832024-12-21T07:47:23.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
7842024-12-21T07:47:23.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
7852024-12-21T07:47:23.943ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7862024-12-21T07:47:23.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7872024-12-21T07:47:23.943ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
7882024-12-21T07:47:23.943ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7892024-12-21T07:47:23.944ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7631194f-d1b1-49e5-a8d9-b577d4135f71", "content-length": "312", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
7902024-12-21T07:47:23.944ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7912024-12-21T07:47:23.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7922024-12-21T07:47:23.946ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7932024-12-21T07:47:23.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7942024-12-21T07:47:23.949ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7952024-12-21T07:47:23.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7962024-12-21T07:47:23.950ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
7972024-12-21T07:47:23.950ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 446.471637ms iteration = 1 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
7982024-12-21T07:47:23.951ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7992024-12-21T07:47:23.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8002024-12-21T07:47:23.953ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8012024-12-21T07:47:23.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8022024-12-21T07:47:23.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
8032024-12-21T07:47:23.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
8042024-12-21T07:47:23.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
8052024-12-21T07:47:23.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
8062024-12-21T07:47:23.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
8072024-12-21T07:47:23.971ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
8082024-12-21T07:47:23.971ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
8092024-12-21T07:47:23.972ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Rack { parent: Fleet, key: 5b228607-94ff-4bfc-99d8-b10385e90443, lookup_type: ById(5b228607-94ff-4bfc-99d8-b10385e90443) } result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
8102024-12-21T07:47:23.972ZDEBGnexus (dropshot_internal): updating rack subnet for rack 5b228607-94ff-4bfc-99d8-b10385e90443 to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
8112024-12-21T07:47:23.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
8122024-12-21T07:47:23.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
8132024-12-21T07:47:23.976ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
8142024-12-21T07:47:23.998ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8152024-12-21T07:47:24.003ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
8162024-12-21T07:47:24.003ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8172024-12-21T07:47:24.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8182024-12-21T07:47:24.005ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8192024-12-21T07:47:24.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8202024-12-21T07:47:24.010ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
8212024-12-21T07:47:24.013ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6819f9f-c173-4800-bccb-4003983e2e6c", "content-length": "24", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} }) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
8222024-12-21T07:47:24.015ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
8232024-12-21T07:47:24.015ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
8242024-12-21T07:47:24.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
8252024-12-21T07:47:24.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
8262024-12-21T07:47:24.019ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
8272024-12-21T07:47:24.019ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
8282024-12-21T07:47:24.019ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "83a273fb-26c1-41c2-bd52-43c6fff0583d", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
8292024-12-21T07:47:24.019ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8302024-12-21T07:47:24.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8312024-12-21T07:47:24.022ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8322024-12-21T07:47:24.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8332024-12-21T07:47:24.025ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
8342024-12-21T07:47:24.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
8352024-12-21T07:47:24.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
8362024-12-21T07:47:24.026ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8372024-12-21T07:47:24.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8382024-12-21T07:47:24.031ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8392024-12-21T07:47:24.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8402024-12-21T07:47:24.033ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8412024-12-21T07:47:24.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8422024-12-21T07:47:24.035ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8432024-12-21T07:47:24.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8442024-12-21T07:47:24.036ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8452024-12-21T07:47:24.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8462024-12-21T07:47:24.038ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8472024-12-21T07:47:24.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8482024-12-21T07:47:24.040ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8492024-12-21T07:47:24.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8502024-12-21T07:47:24.041ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8512024-12-21T07:47:24.041ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8522024-12-21T07:47:24.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8532024-12-21T07:47:24.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8542024-12-21T07:47:24.043ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8552024-12-21T07:47:24.043ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8562024-12-21T07:47:24.045ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8572024-12-21T07:47:24.045ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8582024-12-21T07:47:24.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8592024-12-21T07:47:24.046ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8602024-12-21T07:47:24.048ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8612024-12-21T07:47:24.048ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8622024-12-21T07:47:24.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8632024-12-21T07:47:24.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
8642024-12-21T07:47:24.049ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8652024-12-21T07:47:24.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8662024-12-21T07:47:24.051ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8672024-12-21T07:47:24.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8682024-12-21T07:47:24.052ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8692024-12-21T07:47:24.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8702024-12-21T07:47:24.056ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8712024-12-21T07:47:24.056ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8722024-12-21T07:47:24.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8732024-12-21T07:47:24.058ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8742024-12-21T07:47:24.060ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
8752024-12-21T07:47:24.060ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8762024-12-21T07:47:24.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8772024-12-21T07:47:24.062ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
8782024-12-21T07:47:24.062ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8792024-12-21T07:47:24.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8802024-12-21T07:47:24.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
8812024-12-21T07:47:24.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
8822024-12-21T07:47:24.085ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
8832024-12-21T07:47:24.090ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "19010937-bafc-43f3-8ce0-b5dbc5ddf079", "content-length": "691", "date": "Sat, 21 Dec 2024 07:47:24 GMT"} })
8842024-12-21T07:47:24.090ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
8852024-12-21T07:47:24.090ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
8862024-12-21T07:47:24.090ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
8872024-12-21T07:47:24.092ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 589.48792ms iteration = 1 status = {}
8882024-12-21T07:47:24.095ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
8892024-12-21T07:47:24.095ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8902024-12-21T07:47:24.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8912024-12-21T07:47:24.096ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8922024-12-21T07:47:24.099ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
8932024-12-21T07:47:24.099ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8942024-12-21T07:47:24.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8952024-12-21T07:47:24.100ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8962024-12-21T07:47:24.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8972024-12-21T07:47:24.102ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8982024-12-21T07:47:24.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8992024-12-21T07:47:24.103ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9002024-12-21T07:47:24.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9012024-12-21T07:47:24.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9022024-12-21T07:47:24.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9032024-12-21T07:47:24.106ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
9042024-12-21T07:47:24.106ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = []
9052024-12-21T07:47:24.106ZDEBGnexus (service-firewall-rule-progator): resolved 0 rules for sleds background_task = service_firewall_rule_propagation
9062024-12-21T07:47:24.107ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9072024-12-21T07:47:24.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9082024-12-21T07:47:24.108ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9092024-12-21T07:47:24.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9102024-12-21T07:47:24.110ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9112024-12-21T07:47:24.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9122024-12-21T07:47:24.111ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9132024-12-21T07:47:24.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
9142024-12-21T07:47:24.115ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9152024-12-21T07:47:24.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9162024-12-21T07:47:24.116ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9172024-12-21T07:47:24.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9182024-12-21T07:47:24.118ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9192024-12-21T07:47:24.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9202024-12-21T07:47:24.119ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9212024-12-21T07:47:24.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9222024-12-21T07:47:24.121ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9232024-12-21T07:47:24.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9242024-12-21T07:47:24.123ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9252024-12-21T07:47:24.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9262024-12-21T07:47:24.124ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9272024-12-21T07:47:24.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9282024-12-21T07:47:24.126ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9292024-12-21T07:47:24.130ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
9302024-12-21T07:47:24.130ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9312024-12-21T07:47:24.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9322024-12-21T07:47:24.132ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9332024-12-21T07:47:24.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9342024-12-21T07:47:24.133ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9352024-12-21T07:47:24.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9362024-12-21T07:47:24.135ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9372024-12-21T07:47:24.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9382024-12-21T07:47:24.136ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9392024-12-21T07:47:24.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9402024-12-21T07:47:24.137ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9412024-12-21T07:47:24.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9422024-12-21T07:47:24.139ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9432024-12-21T07:47:24.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9442024-12-21T07:47:24.141ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9452024-12-21T07:47:24.145ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000003, lookup_type: ByName("boundary-ntp") } result = Ok(())
9462024-12-21T07:47:24.145ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9472024-12-21T07:47:24.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9482024-12-21T07:47:24.147ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9492024-12-21T07:47:24.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9502024-12-21T07:47:24.149ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9512024-12-21T07:47:24.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9522024-12-21T07:47:24.156ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9532024-12-21T07:47:24.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9542024-12-21T07:47:24.160ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9552024-12-21T07:47:24.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9562024-12-21T07:47:24.162ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9572024-12-21T07:47:24.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9582024-12-21T07:47:24.164ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9592024-12-21T07:47:24.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9602024-12-21T07:47:24.166ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9612024-12-21T07:47:24.170ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000002, lookup_type: ByName("default") } result = Ok(())
9622024-12-21T07:47:24.170ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
9632024-12-21T07:47:24.182ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ac768b8e-15b4-42ec-afaa-340eec4bebb8", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
9642024-12-21T07:47:24.183ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 679.962993ms iteration = 1 status = {}
9652024-12-21T07:47:24.247ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = []
9662024-12-21T07:47:24.247ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
9672024-12-21T07:47:24.247ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 0 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
9682024-12-21T07:47:24.247ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 744.54856ms
9692024-12-21T07:47:24.247ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 744.714453ms iteration = 1 status = {}
9702024-12-21T07:47:24.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
9712024-12-21T07:47:24.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
9722024-12-21T07:47:24.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
9732024-12-21T07:47:24.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
9742024-12-21T07:47:24.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
9752024-12-21T07:47:24.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
9762024-12-21T07:47:24.296ZDEBGnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
9772024-12-21T07:47:24.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
9782024-12-21T07:47:24.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
9792024-12-21T07:47:24.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
9802024-12-21T07:47:24.307ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Fleet result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
9812024-12-21T07:47:24.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
9822024-12-21T07:47:24.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
9832024-12-21T07:47:24.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
9842024-12-21T07:47:24.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
9852024-12-21T07:47:24.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
9862024-12-21T07:47:24.313ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = IpPool { parent: Fleet, key: d47a19bc-258c-47ac-afe9-0bae456ea968, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
9872024-12-21T07:47:24.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
9882024-12-21T07:47:24.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
9892024-12-21T07:47:24.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
9902024-12-21T07:47:24.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
9912024-12-21T07:47:24.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
9922024-12-21T07:47:24.318ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = IpPool { parent: Fleet, key: d47a19bc-258c-47ac-afe9-0bae456ea968, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
9932024-12-21T07:47:24.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
9942024-12-21T07:47:24.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
9952024-12-21T07:47:24.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
9962024-12-21T07:47:24.337ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = BlueprintConfig result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
9972024-12-21T07:47:24.416ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd305ba5-5008-4689-b0d0-96590d3ed104", "content-length": "30784", "date": "Sat, 21 Dec 2024 07:47:23 GMT"} })
9982024-12-21T07:47:24.418ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
9992024-12-21T07:47:24.418ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
10002024-12-21T07:47:24.418ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
10012024-12-21T07:47:24.419ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10022024-12-21T07:47:24.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10032024-12-21T07:47:24.421ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10042024-12-21T07:47:24.423ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
10052024-12-21T07:47:24.423ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10062024-12-21T07:47:24.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10072024-12-21T07:47:24.501ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = 3f45718f-9869-448a-a087-788e66db5e9d file = nexus/db-queries/src/db/datastore/deployment.rs:457 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10082024-12-21T07:47:24.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10092024-12-21T07:47:24.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10102024-12-21T07:47:24.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10112024-12-21T07:47:24.505ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = BlueprintConfig result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10122024-12-21T07:47:24.518ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:605 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10132024-12-21T07:47:24.518ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:605 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10142024-12-21T07:47:24.518ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:605 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10152024-12-21T07:47:24.518ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:605 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10162024-12-21T07:47:24.518ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:605 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10172024-12-21T07:47:24.518ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:605 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10182024-12-21T07:47:24.518ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:605 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10192024-12-21T07:47:24.518ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:605 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10202024-12-21T07:47:24.602ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:649 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10212024-12-21T07:47:24.623ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:649 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10222024-12-21T07:47:24.652ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:649 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10232024-12-21T07:47:24.674ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:649 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10242024-12-21T07:47:24.686ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 61de7a61-ac32-4049-9cbe-3673f32e1c5d file = nexus/db-queries/src/db/datastore/inventory.rs:1010
10252024-12-21T07:47:24.686ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 61de7a61-ac32-4049-9cbe-3673f32e1c5d time_started = 2024-12-21 07:47:23.793359 UTC
10262024-12-21T07:47:24.686ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.182594614s iteration = 1 status = {"collection_id":"61de7a61-ac32-4049-9cbe-3673f32e1c5d","time_done":"2024-12-21 07:47:24.418096 UTC","time_started":"2024-12-21 07:47:23.793359 UTC"}
10272024-12-21T07:47:24.686ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 2 reason = Dependency
10282024-12-21T07:47:24.686ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10292024-12-21T07:47:24.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10302024-12-21T07:47:24.689ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10312024-12-21T07:47:24.691ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10322024-12-21T07:47:24.691ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10332024-12-21T07:47:24.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10342024-12-21T07:47:24.693ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:80 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
10352024-12-21T07:47:24.693ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 7.283475ms iteration = 2 status = {"error":"rack not yet initialized: 5b228607-94ff-4bfc-99d8-b10385e90443"}
10362024-12-21T07:47:24.699ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:649 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10372024-12-21T07:47:24.699ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:605 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10382024-12-21T07:47:24.699ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:605 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10392024-12-21T07:47:24.699ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:605 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10402024-12-21T07:47:24.699ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:605 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10412024-12-21T07:47:24.699ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:605 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10422024-12-21T07:47:24.699ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:605 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10432024-12-21T07:47:24.699ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:605 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10442024-12-21T07:47:24.699ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:605 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10452024-12-21T07:47:24.699ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:605 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10462024-12-21T07:47:24.699ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:605 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10472024-12-21T07:47:24.699ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:605 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10482024-12-21T07:47:24.699ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:605 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10492024-12-21T07:47:24.699ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:605 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10502024-12-21T07:47:24.699ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:605 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10512024-12-21T07:47:24.723ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:649 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10522024-12-21T07:47:24.723ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:806 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10532024-12-21T07:47:24.723ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 822d17a7-63e8-45ca-a20e-5fddfd18e56f (physical_disk), time_created: 2024-12-21T07:47:23.936556211Z, time_modified: 2024-12-21T07:47:23.936556211Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: c992e3dc-2d80-4655-85d0-78e9a80bf69e, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:809 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10542024-12-21T07:47:24.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10552024-12-21T07:47:24.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10562024-12-21T07:47:24.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10572024-12-21T07:47:24.726ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Fleet result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10582024-12-21T07:47:24.756ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: de8e7a94-ef1b-40f7-abcb-81ae19e3ff15 (physical_disk), time_created: 2024-12-21T07:47:23.936556631Z, time_modified: 2024-12-21T07:47:23.936556631Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2", variant: U2, sled_id: c992e3dc-2d80-4655-85d0-78e9a80bf69e, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:809 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10592024-12-21T07:47:24.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10602024-12-21T07:47:24.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10612024-12-21T07:47:24.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10622024-12-21T07:47:24.760ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Fleet result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10632024-12-21T07:47:24.766ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: c26106c3-311d-4be6-a063-8b1e92d01c19 (physical_disk), time_created: 2024-12-21T07:47:23.936556711Z, time_modified: 2024-12-21T07:47:23.936556711Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2", variant: U2, sled_id: c992e3dc-2d80-4655-85d0-78e9a80bf69e, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:809 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10642024-12-21T07:47:24.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10652024-12-21T07:47:24.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10662024-12-21T07:47:24.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10672024-12-21T07:47:24.770ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Fleet result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10682024-12-21T07:47:24.776ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 02038cc0-2c82-4c54-82d3-56f767f1129a (physical_disk), time_created: 2024-12-21T07:47:23.936556811Z, time_modified: 2024-12-21T07:47:23.936556811Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2", variant: U2, sled_id: c992e3dc-2d80-4655-85d0-78e9a80bf69e, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:809 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10692024-12-21T07:47:24.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10702024-12-21T07:47:24.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10712024-12-21T07:47:24.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10722024-12-21T07:47:24.780ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Fleet result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10732024-12-21T07:47:24.785ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: f161083b-7ab0-479e-b383-7e2767dae5b7 (physical_disk), time_created: 2024-12-21T07:47:23.936556891Z, time_modified: 2024-12-21T07:47:23.936556891Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2", variant: U2, sled_id: c992e3dc-2d80-4655-85d0-78e9a80bf69e, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:809 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10742024-12-21T07:47:24.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10752024-12-21T07:47:24.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10762024-12-21T07:47:24.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10772024-12-21T07:47:24.788ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Fleet result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10782024-12-21T07:47:24.793ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: cc9b408e-70f9-426c-a3fc-b3dd4b48cc2c (physical_disk), time_created: 2024-12-21T07:47:23.936556971Z, time_modified: 2024-12-21T07:47:23.936556971Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2", variant: U2, sled_id: c992e3dc-2d80-4655-85d0-78e9a80bf69e, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:809 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10792024-12-21T07:47:24.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10802024-12-21T07:47:24.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10812024-12-21T07:47:24.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10822024-12-21T07:47:24.796ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Fleet result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10832024-12-21T07:47:24.800ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: e8771149-9ad1-4c6b-b8ad-33a06b23770e (physical_disk), time_created: 2024-12-21T07:47:23.936557051Z, time_modified: 2024-12-21T07:47:23.936557051Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2", variant: U2, sled_id: c992e3dc-2d80-4655-85d0-78e9a80bf69e, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:809 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10842024-12-21T07:47:24.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10852024-12-21T07:47:24.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10862024-12-21T07:47:24.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10872024-12-21T07:47:24.804ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Fleet result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10882024-12-21T07:47:24.808ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 08305eda-f7bf-47ee-a8de-b08b1584bf3c (physical_disk), time_created: 2024-12-21T07:47:23.936557131Z, time_modified: 2024-12-21T07:47:23.936557131Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2", variant: U2, sled_id: c992e3dc-2d80-4655-85d0-78e9a80bf69e, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:809 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10892024-12-21T07:47:24.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10902024-12-21T07:47:24.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10912024-12-21T07:47:24.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10922024-12-21T07:47:24.811ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Fleet result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10932024-12-21T07:47:24.815ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 3d9a4ab4-b2b8-41bc-bec5-c550b6a9dcce (physical_disk), time_created: 2024-12-21T07:47:23.936557201Z, time_modified: 2024-12-21T07:47:23.936557201Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2", variant: U2, sled_id: c992e3dc-2d80-4655-85d0-78e9a80bf69e, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:809 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10942024-12-21T07:47:24.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10952024-12-21T07:47:24.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10962024-12-21T07:47:24.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10972024-12-21T07:47:24.818ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Fleet result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10982024-12-21T07:47:24.822ZINFOnexus (dropshot_internal): Inserted physical disks actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:821 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
10992024-12-21T07:47:24.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11002024-12-21T07:47:24.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11012024-12-21T07:47:24.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11022024-12-21T07:47:24.825ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Fleet result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11032024-12-21T07:47:24.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11042024-12-21T07:47:24.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11052024-12-21T07:47:24.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11062024-12-21T07:47:24.834ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Fleet result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11072024-12-21T07:47:24.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11082024-12-21T07:47:24.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11092024-12-21T07:47:24.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11102024-12-21T07:47:24.841ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Fleet result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11112024-12-21T07:47:24.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11122024-12-21T07:47:24.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11132024-12-21T07:47:24.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11142024-12-21T07:47:24.848ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Fleet result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11152024-12-21T07:47:24.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11162024-12-21T07:47:24.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11172024-12-21T07:47:24.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11182024-12-21T07:47:24.858ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Fleet result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11192024-12-21T07:47:24.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11202024-12-21T07:47:24.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11212024-12-21T07:47:24.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11222024-12-21T07:47:24.865ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Fleet result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11232024-12-21T07:47:24.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11242024-12-21T07:47:24.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11252024-12-21T07:47:24.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11262024-12-21T07:47:24.873ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Fleet result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11272024-12-21T07:47:24.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11282024-12-21T07:47:24.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11292024-12-21T07:47:24.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11302024-12-21T07:47:24.880ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Fleet result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11312024-12-21T07:47:24.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11322024-12-21T07:47:24.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11332024-12-21T07:47:24.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11342024-12-21T07:47:24.887ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Fleet result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11352024-12-21T07:47:24.892ZINFOnexus (dropshot_internal): Inserted zpools actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:833 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11362024-12-21T07:47:25.194ZINFOnexus (dropshot_internal): Inserted datasets actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:863 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11372024-12-21T07:47:25.227ZINFOnexus (dropshot_internal): Populated DNS tables for internal DNS actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:874 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11382024-12-21T07:47:25.231ZINFOnexus (dropshot_internal): Populated DNS tables for external DNS actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:883 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11392024-12-21T07:47:25.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11402024-12-21T07:47:25.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11412024-12-21T07:47:25.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11422024-12-21T07:47:25.234ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Fleet result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11432024-12-21T07:47:25.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11442024-12-21T07:47:25.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11452024-12-21T07:47:25.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11462024-12-21T07:47:25.237ZDEBGnexus (dropshot_internal): authorize result action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Fleet result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11472024-12-21T07:47:25.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11482024-12-21T07:47:25.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11492024-12-21T07:47:25.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11502024-12-21T07:47:25.278ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = DnsConfig result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11512024-12-21T07:47:25.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11522024-12-21T07:47:25.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11532024-12-21T07:47:25.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11542024-12-21T07:47:25.283ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = DnsConfig result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11552024-12-21T07:47:25.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11562024-12-21T07:47:25.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11572024-12-21T07:47:25.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11582024-12-21T07:47:25.289ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = DnsConfig result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11592024-12-21T07:47:25.305ZINFOnexus (dropshot_internal): Created recovery silo actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:450 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11602024-12-21T07:47:25.314ZINFOnexus (dropshot_internal): Created recovery user actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:466 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11612024-12-21T07:47:25.322ZINFOnexus (dropshot_internal): Created recovery user's password actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:480 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11622024-12-21T07:47:25.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11632024-12-21T07:47:25.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11642024-12-21T07:47:25.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11652024-12-21T07:47:25.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11662024-12-21T07:47:25.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11672024-12-21T07:47:25.327ZDEBGnexus (dropshot_internal): authorize result action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) } result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11682024-12-21T07:47:25.327ZDEBGnexus (dropshot_internal): Generated role assignment queries actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11692024-12-21T07:47:25.332ZINFOnexus (dropshot_internal): Granted Silo privileges actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:508 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11702024-12-21T07:47:25.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11712024-12-21T07:47:25.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11722024-12-21T07:47:25.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11732024-12-21T07:47:25.334ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Fleet result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11742024-12-21T07:47:25.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11752024-12-21T07:47:25.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11762024-12-21T07:47:25.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11772024-12-21T07:47:25.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11782024-12-21T07:47:25.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11792024-12-21T07:47:25.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11802024-12-21T07:47:25.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11812024-12-21T07:47:25.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11822024-12-21T07:47:25.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11832024-12-21T07:47:25.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11842024-12-21T07:47:25.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11852024-12-21T07:47:25.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11862024-12-21T07:47:25.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11872024-12-21T07:47:25.367ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11882024-12-21T07:47:25.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11892024-12-21T07:47:25.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11902024-12-21T07:47:25.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11912024-12-21T07:47:25.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11922024-12-21T07:47:25.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11932024-12-21T07:47:25.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11942024-12-21T07:47:25.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11952024-12-21T07:47:25.374ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11962024-12-21T07:47:25.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11972024-12-21T07:47:25.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11982024-12-21T07:47:25.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
11992024-12-21T07:47:25.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12002024-12-21T07:47:25.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12012024-12-21T07:47:25.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12022024-12-21T07:47:25.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12032024-12-21T07:47:25.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12042024-12-21T07:47:25.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12052024-12-21T07:47:25.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12062024-12-21T07:47:25.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12072024-12-21T07:47:25.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12082024-12-21T07:47:25.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12092024-12-21T07:47:25.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12102024-12-21T07:47:25.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12112024-12-21T07:47:25.388ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12122024-12-21T07:47:25.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12132024-12-21T07:47:25.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12142024-12-21T07:47:25.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12152024-12-21T07:47:25.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12162024-12-21T07:47:25.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12172024-12-21T07:47:25.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12182024-12-21T07:47:25.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12192024-12-21T07:47:25.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12202024-12-21T07:47:25.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12212024-12-21T07:47:25.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12222024-12-21T07:47:25.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12232024-12-21T07:47:25.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12242024-12-21T07:47:25.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12252024-12-21T07:47:25.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12262024-12-21T07:47:25.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12272024-12-21T07:47:25.403ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12282024-12-21T07:47:25.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12292024-12-21T07:47:25.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12302024-12-21T07:47:25.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12312024-12-21T07:47:25.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12322024-12-21T07:47:25.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12332024-12-21T07:47:25.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12342024-12-21T07:47:25.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12352024-12-21T07:47:25.410ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12362024-12-21T07:47:25.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12372024-12-21T07:47:25.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12382024-12-21T07:47:25.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12392024-12-21T07:47:25.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12402024-12-21T07:47:25.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12412024-12-21T07:47:25.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12422024-12-21T07:47:25.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12432024-12-21T07:47:25.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12442024-12-21T07:47:25.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12452024-12-21T07:47:25.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12462024-12-21T07:47:25.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12472024-12-21T07:47:25.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12482024-12-21T07:47:25.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12492024-12-21T07:47:25.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12502024-12-21T07:47:25.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12512024-12-21T07:47:25.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12522024-12-21T07:47:25.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12532024-12-21T07:47:25.427ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12542024-12-21T07:47:25.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12552024-12-21T07:47:25.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12562024-12-21T07:47:25.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12572024-12-21T07:47:25.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12582024-12-21T07:47:25.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12592024-12-21T07:47:25.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12602024-12-21T07:47:25.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12612024-12-21T07:47:25.434ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12622024-12-21T07:47:25.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12632024-12-21T07:47:25.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12642024-12-21T07:47:25.443ZDEBGnexus: resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 95e048ed-0de5-4c3b-a368-18ddaf75c49e, kind: Service { id: 8fbd6070-9acd-409b-bda8-dadf2a05b00e }, name: Name("nexus-8fbd6070-9acd-409b-bda8-dadf2a05b00e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9b744bef-fce0-46ab-93b4-a179a1aaa5aa, kind: Service { id: 4b205886-0970-4a9e-bff0-ae1192504434 }, name: Name("nexus-4b205886-0970-4a9e-bff0-ae1192504434"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c592275e-d41b-414d-af17-bfadf96c8a68, kind: Service { id: 428cd3f9-eecf-4305-9c0b-1698df6403fd }, name: Name("nexus-428cd3f9-eecf-4305-9c0b-1698df6403fd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 528044ef-9437-43f9-b92d-7d435209bb68, kind: Service { id: e6b54c38-8771-4091-8fc3-2bbdae94bd35 }, name: Name("external-dns-e6b54c38-8771-4091-8fc3-2bbdae94bd35"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 45])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6b349cca-d953-4887-a151-4eb9ed8779f4, kind: Service { id: 1595c632-cfae-4f6b-937d-d413dd8cf0b7 }, name: Name("external-dns-1595c632-cfae-4f6b-937d-d413dd8cf0b7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
12652024-12-21T07:47:25.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12662024-12-21T07:47:25.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12672024-12-21T07:47:25.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12682024-12-21T07:47:25.446ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Fleet result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12692024-12-21T07:47:25.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 roles = RoleSet { roles: {} } uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12702024-12-21T07:47:25.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 resource = Database result = Ok(()) uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12712024-12-21T07:47:25.447ZDEBGnexus: Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
12722024-12-21T07:47:25.448ZDEBGnexus: resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 528044ef-9437-43f9-b92d-7d435209bb68, kind: Service { id: e6b54c38-8771-4091-8fc3-2bbdae94bd35 }, name: Name("external-dns-e6b54c38-8771-4091-8fc3-2bbdae94bd35"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 45])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6b349cca-d953-4887-a151-4eb9ed8779f4, kind: Service { id: 1595c632-cfae-4f6b-937d-d413dd8cf0b7 }, name: Name("external-dns-1595c632-cfae-4f6b-937d-d413dd8cf0b7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 95e048ed-0de5-4c3b-a368-18ddaf75c49e, kind: Service { id: 8fbd6070-9acd-409b-bda8-dadf2a05b00e }, name: Name("nexus-8fbd6070-9acd-409b-bda8-dadf2a05b00e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9b744bef-fce0-46ab-93b4-a179a1aaa5aa, kind: Service { id: 4b205886-0970-4a9e-bff0-ae1192504434 }, name: Name("nexus-4b205886-0970-4a9e-bff0-ae1192504434"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c592275e-d41b-414d-af17-bfadf96c8a68, kind: Service { id: 428cd3f9-eecf-4305-9c0b-1698df6403fd }, name: Name("nexus-428cd3f9-eecf-4305-9c0b-1698df6403fd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
12732024-12-21T07:47:25.448ZDEBGnexus: resolved 2 rules for sleds
12742024-12-21T07:47:25.509ZDEBGnexus: resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: c992e3dc-2d80-4655-85d0-78e9a80bf69e, time_created: 2024-12-21T07:47:23.178624Z, time_modified: 2024-12-21T07:47:23.178624Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
12752024-12-21T07:47:25.509ZDEBGnexus: sending firewall rules to sled agents
12762024-12-21T07:47:25.509ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
12772024-12-21T07:47:25.509ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
12782024-12-21T07:47:25.512ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
12792024-12-21T07:47:25.512ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
12802024-12-21T07:47:25.513ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
12812024-12-21T07:47:25.515ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
12822024-12-21T07:47:25.546ZDEBGnexus: client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
12832024-12-21T07:47:25.550ZDEBGnexus: client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "51262307-bda7-497b-bca3-4303a2ce34a5", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
12842024-12-21T07:47:25.552ZINFOnexus: updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
12852024-12-21T07:47:25.552ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 2 reason = Signaled
12862024-12-21T07:47:25.552ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 2 reason = Signaled
12872024-12-21T07:47:25.552ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
12882024-12-21T07:47:25.552ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12892024-12-21T07:47:25.552ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 2 reason = Signaled
12902024-12-21T07:47:25.552ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 2 reason = Signaled
12912024-12-21T07:47:25.552ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
12922024-12-21T07:47:25.552ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 2 reason = Signaled
12932024-12-21T07:47:25.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1620529 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47284 req_id = 08581188-c77d-4f81-9b95-590049127aa1 response_code = 204 uri = /racks/5b228607-94ff-4bfc-99d8-b10385e90443/initialization-complete
12942024-12-21T07:47:25.552ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12952024-12-21T07:47:25.552ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12962024-12-21T07:47:25.552ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 2 reason = Signaled
12972024-12-21T07:47:25.552ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
12982024-12-21T07:47:25.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12992024-12-21T07:47:25.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13002024-12-21T07:47:25.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13012024-12-21T07:47:25.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
13022024-12-21T07:47:25.552ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("481de7e8-0737-474b-8c33-e6e8bc6477be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("683a9892-43cd-4dd8-a983-26cccd988df0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 965, tv_nsec: 507425380 } })
13032024-12-21T07:47:25.552ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1595c632-cfae-4f6b-937d-d413dd8cf0b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 965, tv_nsec: 507608913 } })
13042024-12-21T07:47:25.552ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13052024-12-21T07:47:25.553ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
13062024-12-21T07:47:25.553ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
13072024-12-21T07:47:25.553ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.177051ms iteration = 2 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
13082024-12-21T07:47:25.553ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.204711ms iteration = 2 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
13092024-12-21T07:47:25.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13102024-12-21T07:47:25.553ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13112024-12-21T07:47:25.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13122024-12-21T07:47:25.554ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13132024-12-21T07:47:25.555ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13142024-12-21T07:47:25.555ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13152024-12-21T07:47:25.556ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13162024-12-21T07:47:25.556ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
13172024-12-21T07:47:25.556ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13182024-12-21T07:47:25.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13192024-12-21T07:47:25.557ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
13202024-12-21T07:47:25.557ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
13212024-12-21T07:47:25.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
13222024-12-21T07:47:25.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13232024-12-21T07:47:25.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
13242024-12-21T07:47:25.560ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
13252024-12-21T07:47:25.560ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
13262024-12-21T07:47:25.560ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
13272024-12-21T07:47:25.560ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13282024-12-21T07:47:25.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13292024-12-21T07:47:25.562ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13302024-12-21T07:47:25.562ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13312024-12-21T07:47:25.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13322024-12-21T07:47:25.563ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13332024-12-21T07:47:25.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13342024-12-21T07:47:25.564ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13352024-12-21T07:47:25.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13362024-12-21T07:47:25.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
13372024-12-21T07:47:25.566ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13382024-12-21T07:47:25.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13392024-12-21T07:47:25.567ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(6b1a85ac-7e74-4f33-a8e4-8fdc94ea2812, 0), (61de7a61-ac32-4049-9cbe-3673f32e1c5d, 0), (32aca71e-b39b-47ab-a2c7-b9f0a55c8abc, 0)]
13402024-12-21T07:47:25.568ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 965, tv_nsec: 523177900 } })
13412024-12-21T07:47:25.596ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13422024-12-21T07:47:25.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13432024-12-21T07:47:25.598ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13442024-12-21T07:47:25.600ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
13452024-12-21T07:47:25.600ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13462024-12-21T07:47:25.600ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
13472024-12-21T07:47:25.600ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
13482024-12-21T07:47:25.600ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
13492024-12-21T07:47:25.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13502024-12-21T07:47:25.601ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a893d7f-7e26-4133-b53d-0b0b81bcb6d8", "content-length": "476", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
13512024-12-21T07:47:25.601ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
13522024-12-21T07:47:25.601ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ec1f217-19ec-4462-94c3-34ba86b62624", "content-length": "734", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
13532024-12-21T07:47:25.601ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
13542024-12-21T07:47:25.601ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "59189be6-7570-4ab0-bbb3-a27f3786f9c4", "content-length": "111", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
13552024-12-21T07:47:25.601ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
13562024-12-21T07:47:25.602ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6bbe1e76-a62c-46b7-8702-9ab9de254596", "content-length": "111", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
13572024-12-21T07:47:25.602ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
13582024-12-21T07:47:25.602ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d2508a8-ab68-4f16-a508-74f45d20e23c", "content-length": "167", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
13592024-12-21T07:47:25.602ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
13602024-12-21T07:47:25.602ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f73df3a2-fa59-4b52-b737-b8c2fdfd7ad3", "content-length": "167", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
13612024-12-21T07:47:25.602ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
13622024-12-21T07:47:25.603ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "552e8580-f9ce-40d0-9ec7-3928129a82c5", "content-length": "175", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
13632024-12-21T07:47:25.603ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
13642024-12-21T07:47:25.603ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "90b338a4-44d1-4395-b2b0-ea9ddf441da1", "content-length": "175", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
13652024-12-21T07:47:25.603ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
13662024-12-21T07:47:25.603ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b161855-d341-404f-a16c-37c730c43b45", "content-length": "702", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
13672024-12-21T07:47:25.603ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
13682024-12-21T07:47:25.603ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2947db7a-adcc-43ac-b1e3-51e7217753b2", "content-length": "727", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
13692024-12-21T07:47:25.603ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
13702024-12-21T07:47:25.603ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a2db84c-a3da-409a-bed2-0d38d12a21e0", "content-length": "729", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
13712024-12-21T07:47:25.603ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
13722024-12-21T07:47:25.604ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8dca01fe-12d9-4048-ab5c-32cb75860ca4", "content-length": "728", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
13732024-12-21T07:47:25.604ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
13742024-12-21T07:47:25.604ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca7eb0f1-b0b0-45d8-ba61-e72c0e142092", "content-length": "722", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
13752024-12-21T07:47:25.604ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
13762024-12-21T07:47:25.604ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a358e2e3-2852-451f-8a7b-f59a0637f61b", "content-length": "109", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
13772024-12-21T07:47:25.604ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
13782024-12-21T07:47:25.604ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e905e7db-bdbf-42e7-85f6-88d2d7d38be6", "content-length": "109", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
13792024-12-21T07:47:25.604ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
13802024-12-21T07:47:25.605ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "411e5802-35d2-4e06-b9b7-0d62d12a0321", "content-length": "169", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
13812024-12-21T07:47:25.605ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
13822024-12-21T07:47:25.605ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca73287d-5e1a-4f47-80ce-c8af2ea0e094", "content-length": "169", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
13832024-12-21T07:47:25.605ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
13842024-12-21T07:47:25.605ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "59c9344a-fdaf-45f4-ac9c-534dde73f3c2", "content-length": "178", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
13852024-12-21T07:47:25.605ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
13862024-12-21T07:47:25.605ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "84042685-144b-46c5-9fd2-fc109af562de", "content-length": "178", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
13872024-12-21T07:47:25.606ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
13882024-12-21T07:47:25.606ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "677a7f64-7bd9-4ecd-801b-f94a41b9a11a", "content-length": "702", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
13892024-12-21T07:47:25.606ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
13902024-12-21T07:47:25.606ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b16d4a8b-c67a-47ef-a048-9394f943492b", "content-length": "727", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
13912024-12-21T07:47:25.606ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
13922024-12-21T07:47:25.606ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c29fd1c-2b7d-4207-99d1-20ba535e2255", "content-length": "729", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
13932024-12-21T07:47:25.606ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
13942024-12-21T07:47:25.606ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fddbbfbd-2108-4157-8fad-5feab92c5a15", "content-length": "728", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
13952024-12-21T07:47:25.606ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
13962024-12-21T07:47:25.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
13972024-12-21T07:47:25.608ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13982024-12-21T07:47:25.608ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
13992024-12-21T07:47:25.608ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
14002024-12-21T07:47:25.608ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
14012024-12-21T07:47:25.608ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14022024-12-21T07:47:25.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14032024-12-21T07:47:25.610ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
14042024-12-21T07:47:25.610ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
14052024-12-21T07:47:25.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
14062024-12-21T07:47:25.611ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
14072024-12-21T07:47:25.611ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 0 version = 2
14082024-12-21T07:47:25.611ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14092024-12-21T07:47:25.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14102024-12-21T07:47:25.611ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14112024-12-21T07:47:25.612ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14122024-12-21T07:47:25.613ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
14132024-12-21T07:47:25.613ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
14142024-12-21T07:47:25.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
14152024-12-21T07:47:25.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
14162024-12-21T07:47:25.615ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14172024-12-21T07:47:25.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14182024-12-21T07:47:25.636ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14192024-12-21T07:47:25.639ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
14202024-12-21T07:47:25.639ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14212024-12-21T07:47:25.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14222024-12-21T07:47:25.641ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 1 version = 2
14232024-12-21T07:47:25.641ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
14242024-12-21T07:47:25.641ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_external dns_group = external file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 2
14252024-12-21T07:47:25.641ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 89.105868ms iteration = 2 status = {"generation":2}
14262024-12-21T07:47:25.641ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 3 reason = Dependency
14272024-12-21T07:47:25.651ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (initial) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:47:21.583817Z, time_modified: 2024-12-21T07:47:21.583817Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(1)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(1)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:77
14282024-12-21T07:47:25.651ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 99.542347ms iteration = 2 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]}},"default_endpoint":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
14292024-12-21T07:47:25.653ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
14302024-12-21T07:47:25.653ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
14312024-12-21T07:47:25.679ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
14322024-12-21T07:47:25.683ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
14332024-12-21T07:47:25.683ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
14342024-12-21T07:47:25.683ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14352024-12-21T07:47:25.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14362024-12-21T07:47:25.685ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14372024-12-21T07:47:25.688ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
14382024-12-21T07:47:25.688ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14392024-12-21T07:47:25.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14402024-12-21T07:47:25.693ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
14412024-12-21T07:47:25.693ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
14422024-12-21T07:47:25.694ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_internal dns_group = internal file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 1
14432024-12-21T07:47:25.694ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 141.954185ms iteration = 2 status = {"generation":1}
14442024-12-21T07:47:25.694ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 3 reason = Dependency
14452024-12-21T07:47:25.725ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
14462024-12-21T07:47:25.741ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
14472024-12-21T07:47:25.751ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "064b270b-be94-4381-aac4-ae7edf9e4eef", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
14482024-12-21T07:47:25.751ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
14492024-12-21T07:47:25.753ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "57e5f964-49be-46dd-b7f8-bb851739eb0a", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
14502024-12-21T07:47:25.753ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
14512024-12-21T07:47:25.754ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
14522024-12-21T07:47:25.755ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 113.827343ms iteration = 3 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
14532024-12-21T07:47:25.774ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
14542024-12-21T07:47:25.808ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
14552024-12-21T07:47:25.822ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "10640c23-b859-4b69-b3c7-832b548f1497", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
14562024-12-21T07:47:25.822ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
14572024-12-21T07:47:25.825ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "40914335-beef-4f94-b501-3c68f0b15781", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
14582024-12-21T07:47:25.825ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
14592024-12-21T07:47:25.831ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "2220125c-8c4e-4540-917a-8f0195e61bb8", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
14602024-12-21T07:47:25.831ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
14612024-12-21T07:47:25.833ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
14622024-12-21T07:47:25.833ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 139.148427ms iteration = 3 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
14632024-12-21T07:47:25.884ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "be346e0d-6c51-46f1-9339-b1a8f30d11e1", "content-length": "30785", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
14642024-12-21T07:47:25.886ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
14652024-12-21T07:47:25.886ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
14662024-12-21T07:47:25.886ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
14672024-12-21T07:47:25.888ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
14682024-12-21T07:47:25.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
14692024-12-21T07:47:25.890ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14702024-12-21T07:47:25.891ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
14712024-12-21T07:47:25.892ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
14722024-12-21T07:47:25.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
14732024-12-21T07:47:25.916ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:48005
14742024-12-21T07:47:25.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48005 req_id = c6080f2e-c9d9-4f79-b337-dfdabf06cc96 roles = RoleSet { roles: {} } uri = /metrics/producers
14752024-12-21T07:47:25.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48005 req_id = c6080f2e-c9d9-4f79-b337-dfdabf06cc96 resource = Database result = Ok(()) uri = /metrics/producers
14762024-12-21T07:47:25.922ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
14772024-12-21T07:47:25.922ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
14782024-12-21T07:47:25.924ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
14792024-12-21T07:47:25.924ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
14802024-12-21T07:47:25.925ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14812024-12-21T07:47:25.928ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5b228607-94ff-4bfc-99d8-b10385e90443, lookup_type: ById(5b228607-94ff-4bfc-99d8-b10385e90443) } result = Ok(())
14822024-12-21T07:47:25.928ZINFOnexus: Rack initialized file = nexus/src/app/rack.rs:765
14832024-12-21T07:47:25.928ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14842024-12-21T07:47:25.928ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14852024-12-21T07:47:25.930ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14862024-12-21T07:47:25.930ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14872024-12-21T07:47:25.933ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14882024-12-21T07:47:25.933ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14892024-12-21T07:47:25.934ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14902024-12-21T07:47:25.934ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14912024-12-21T07:47:25.936ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14922024-12-21T07:47:25.936ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14932024-12-21T07:47:25.937ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14942024-12-21T07:47:25.937ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14952024-12-21T07:47:25.938ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14962024-12-21T07:47:25.941ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
14972024-12-21T07:47:25.941ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14982024-12-21T07:47:25.941ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14992024-12-21T07:47:25.943ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15002024-12-21T07:47:25.943ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15012024-12-21T07:47:25.944ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15022024-12-21T07:47:25.944ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15032024-12-21T07:47:25.945ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15042024-12-21T07:47:25.948ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
15052024-12-21T07:47:25.948ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15062024-12-21T07:47:25.948ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15072024-12-21T07:47:25.954ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15082024-12-21T07:47:25.954ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15092024-12-21T07:47:25.955ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15102024-12-21T07:47:25.956ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15112024-12-21T07:47:25.957ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15122024-12-21T07:47:25.957ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15132024-12-21T07:47:25.959ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15142024-12-21T07:47:25.959ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15152024-12-21T07:47:25.960ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15162024-12-21T07:47:25.960ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15172024-12-21T07:47:25.961ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15182024-12-21T07:47:25.961ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15192024-12-21T07:47:25.963ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15202024-12-21T07:47:25.965ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
15212024-12-21T07:47:25.965ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15222024-12-21T07:47:25.966ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15232024-12-21T07:47:25.967ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15242024-12-21T07:47:25.967ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15252024-12-21T07:47:25.968ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15262024-12-21T07:47:25.968ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15272024-12-21T07:47:25.970ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15282024-12-21T07:47:25.971ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15292024-12-21T07:47:25.973ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15302024-12-21T07:47:25.973ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15312024-12-21T07:47:25.974ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15322024-12-21T07:47:25.974ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15332024-12-21T07:47:25.975ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15342024-12-21T07:47:25.975ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15352024-12-21T07:47:25.976ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15362024-12-21T07:47:25.980ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
15372024-12-21T07:47:25.980ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15382024-12-21T07:47:25.980ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15392024-12-21T07:47:25.981ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15402024-12-21T07:47:25.981ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15412024-12-21T07:47:25.982ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15422024-12-21T07:47:25.982ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15432024-12-21T07:47:25.983ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = b2e6180f-2896-4592-b155-f5ca3f904fa7
15442024-12-21T07:47:25.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62662 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48005 req_id = c6080f2e-c9d9-4f79-b337-dfdabf06cc96 response_code = 201 uri = /metrics/producers
15452024-12-21T07:47:25.984ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15462024-12-21T07:47:25.987ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
15472024-12-21T07:47:25.987ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15482024-12-21T07:47:25.987ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15492024-12-21T07:47:25.992ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15502024-12-21T07:47:25.993ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15512024-12-21T07:47:25.994ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15522024-12-21T07:47:25.994ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15532024-12-21T07:47:25.995ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15542024-12-21T07:47:25.995ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15552024-12-21T07:47:25.997ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15562024-12-21T07:47:25.998ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15572024-12-21T07:47:25.999ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15582024-12-21T07:47:25.999ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15592024-12-21T07:47:26.000ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15602024-12-21T07:47:26.000ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15612024-12-21T07:47:26.001ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15622024-12-21T07:47:26.001ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15632024-12-21T07:47:26.003ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15642024-12-21T07:47:26.006ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
15652024-12-21T07:47:26.006ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15662024-12-21T07:47:26.006ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15672024-12-21T07:47:26.007ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15682024-12-21T07:47:26.007ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15692024-12-21T07:47:26.008ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15702024-12-21T07:47:26.008ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15712024-12-21T07:47:26.009ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15722024-12-21T07:47:26.012ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
15732024-12-21T07:47:26.012ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15742024-12-21T07:47:26.013ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15752024-12-21T07:47:26.018ZDEBGnexus (InternalApi): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 528044ef-9437-43f9-b92d-7d435209bb68, kind: Service { id: e6b54c38-8771-4091-8fc3-2bbdae94bd35 }, name: Name("external-dns-e6b54c38-8771-4091-8fc3-2bbdae94bd35"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 45])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6b349cca-d953-4887-a151-4eb9ed8779f4, kind: Service { id: 1595c632-cfae-4f6b-937d-d413dd8cf0b7 }, name: Name("external-dns-1595c632-cfae-4f6b-937d-d413dd8cf0b7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 95e048ed-0de5-4c3b-a368-18ddaf75c49e, kind: Service { id: 8fbd6070-9acd-409b-bda8-dadf2a05b00e }, name: Name("nexus-8fbd6070-9acd-409b-bda8-dadf2a05b00e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9b744bef-fce0-46ab-93b4-a179a1aaa5aa, kind: Service { id: 4b205886-0970-4a9e-bff0-ae1192504434 }, name: Name("nexus-4b205886-0970-4a9e-bff0-ae1192504434"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c592275e-d41b-414d-af17-bfadf96c8a68, kind: Service { id: 428cd3f9-eecf-4305-9c0b-1698df6403fd }, name: Name("nexus-428cd3f9-eecf-4305-9c0b-1698df6403fd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
15762024-12-21T07:47:26.018ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15772024-12-21T07:47:26.018ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15782024-12-21T07:47:26.019ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15792024-12-21T07:47:26.021ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
15802024-12-21T07:47:26.021ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15812024-12-21T07:47:26.021ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15822024-12-21T07:47:26.034ZDEBGnexus (InternalApi): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
15832024-12-21T07:47:26.034ZDEBGnexus (InternalApi): resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 528044ef-9437-43f9-b92d-7d435209bb68, kind: Service { id: e6b54c38-8771-4091-8fc3-2bbdae94bd35 }, name: Name("external-dns-e6b54c38-8771-4091-8fc3-2bbdae94bd35"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 45])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6b349cca-d953-4887-a151-4eb9ed8779f4, kind: Service { id: 1595c632-cfae-4f6b-937d-d413dd8cf0b7 }, name: Name("external-dns-1595c632-cfae-4f6b-937d-d413dd8cf0b7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 95e048ed-0de5-4c3b-a368-18ddaf75c49e, kind: Service { id: 8fbd6070-9acd-409b-bda8-dadf2a05b00e }, name: Name("nexus-8fbd6070-9acd-409b-bda8-dadf2a05b00e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9b744bef-fce0-46ab-93b4-a179a1aaa5aa, kind: Service { id: 4b205886-0970-4a9e-bff0-ae1192504434 }, name: Name("nexus-4b205886-0970-4a9e-bff0-ae1192504434"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c592275e-d41b-414d-af17-bfadf96c8a68, kind: Service { id: 428cd3f9-eecf-4305-9c0b-1698df6403fd }, name: Name("nexus-428cd3f9-eecf-4305-9c0b-1698df6403fd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
15842024-12-21T07:47:26.034ZDEBGnexus (InternalApi): resolved 2 rules for sleds
15852024-12-21T07:47:26.092ZDEBGnexus (InternalApi): resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: c992e3dc-2d80-4655-85d0-78e9a80bf69e, time_created: 2024-12-21T07:47:23.178624Z, time_modified: 2024-12-21T07:47:23.178624Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
15862024-12-21T07:47:26.092ZDEBGnexus (InternalApi): sending firewall rules to sled agents
15872024-12-21T07:47:26.092ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15882024-12-21T07:47:26.093ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15892024-12-21T07:47:26.096ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15902024-12-21T07:47:26.096ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15912024-12-21T07:47:26.097ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15922024-12-21T07:47:26.100ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
15932024-12-21T07:47:26.130ZDEBGnexus (InternalApi): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15942024-12-21T07:47:26.131ZDEBGnexus (InternalApi): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "a9d6af3b-0455-4212-926c-9e4a7b6136fc", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
15952024-12-21T07:47:26.132ZINFOnexus (InternalApi): updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
15962024-12-21T07:47:26.132ZINFOnexus: plumbed initial IP allowlist file = nexus/src/app/allow_list.rs:161
15972024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = / versions = all
15982024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /access versions = all
15992024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /assets/{path} versions = all
16002024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/auth versions = all
16012024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/confirm versions = all
16022024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /device/success versions = all
16032024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/token versions = all
16042024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /device/verify versions = all
16052024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /experimental/v1/probes versions = all
16062024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /experimental/v1/probes versions = all
16072024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /experimental/v1/probes/{probe} versions = all
16082024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /experimental/v1/probes/{probe} versions = all
16092024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /images versions = all
16102024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login versions = all
16112024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/local versions = all
16122024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
16132024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
16142024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
16152024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /lookup/{path} versions = all
16162024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /projects/{path} versions = all
16172024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /projects-new versions = all
16182024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /settings/{path} versions = all
16192024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /system/{path} versions = all
16202024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /utilization versions = all
16212024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/certificates versions = all
16222024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/certificates versions = all
16232024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/certificates/{certificate} versions = all
16242024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/certificates/{certificate} versions = all
16252024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks versions = all
16262024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks versions = all
16272024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/disks/{disk} versions = all
16282024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks/{disk} versions = all
16292024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write versions = all
16302024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
16312024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
16322024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/finalize versions = all
16332024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
16342024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/floating-ips versions = all
16352024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips versions = all
16362024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
16372024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/floating-ips/{floating_ip} versions = all
16382024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
16392024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
16402024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
16412024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/groups versions = all
16422024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/groups/{group_id} versions = all
16432024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/images versions = all
16442024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images versions = all
16452024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/images/{image} versions = all
16462024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/images/{image} versions = all
16472024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images/{image}/demote versions = all
16482024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images/{image}/promote versions = all
16492024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances versions = all
16502024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances versions = all
16512024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/instances/{instance} versions = all
16522024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance} versions = all
16532024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/instances/{instance} versions = all
16542024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/disks versions = all
16552024-12-21T07:47:26.142ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/disks/attach versions = all
16562024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/disks/detach versions = all
16572024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/external-ips versions = all
16582024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
16592024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
16602024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/reboot versions = all
16612024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/serial-console versions = all
16622024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
16632024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
16642024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/start versions = all
16652024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/stop versions = all
16662024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/internet-gateway-ip-addresses versions = all
16672024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/internet-gateway-ip-addresses versions = all
16682024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
16692024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/internet-gateway-ip-pools versions = all
16702024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/internet-gateway-ip-pools versions = all
16712024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
16722024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/internet-gateways versions = all
16732024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/internet-gateways versions = all
16742024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
16752024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/internet-gateways/{gateway} versions = all
16762024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ip-pools versions = all
16772024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ip-pools/{pool} versions = all
16782024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/login/{silo_name}/local versions = all
16792024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/logout versions = all
16802024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me versions = all
16812024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/groups versions = all
16822024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/ssh-keys versions = all
16832024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/me/ssh-keys versions = all
16842024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
16852024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
16862024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/metrics/{metric_name} versions = all
16872024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/network-interfaces versions = all
16882024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/network-interfaces versions = all
16892024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/network-interfaces/{interface} versions = all
16902024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/network-interfaces/{interface} versions = all
16912024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/network-interfaces/{interface} versions = all
16922024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ping versions = all
16932024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/policy versions = all
16942024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/policy versions = all
16952024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects versions = all
16962024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/projects versions = all
16972024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/projects/{project} versions = all
16982024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects/{project} versions = all
16992024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/projects/{project} versions = all
17002024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects/{project}/policy versions = all
17012024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/projects/{project}/policy versions = all
17022024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/snapshots versions = all
17032024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/snapshots versions = all
17042024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/snapshots/{snapshot} versions = all
17052024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/snapshots/{snapshot} versions = all
17062024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/disks versions = all
17072024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
17082024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/racks versions = all
17092024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
17102024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds versions = all
17112024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/hardware/sleds versions = all
17122024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
17132024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
17142024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
17152024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
17162024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
17172024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switch-port versions = all
17182024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
17192024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
17202024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
17212024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switches versions = all
17222024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
17232024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/identity-providers versions = all
17242024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/local/users versions = all
17252024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
17262024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
17272024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/saml versions = all
17282024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
17292024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools versions = all
17302024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools versions = all
17312024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
17322024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool} versions = all
17332024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/ip-pools/{pool} versions = all
17342024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
17352024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
17362024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
17372024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
17382024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
17392024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
17402024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
17412024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
17422024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools-service versions = all
17432024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools-service/ranges versions = all
17442024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
17452024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
17462024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/metrics/{metric_name} versions = all
17472024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/address-lot versions = all
17482024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/address-lot versions = all
17492024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
17502024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
17512024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/allow-list versions = all
17522024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/networking/allow-list versions = all
17532024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bfd-disable versions = all
17542024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bfd-enable versions = all
17552024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bfd-status versions = all
17562024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/bgp versions = all
17572024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp versions = all
17582024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bgp versions = all
17592024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-announce-set versions = all
17602024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
17612024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
17622024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
17632024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-exported versions = all
17642024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-message-history versions = all
17652024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
17662024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-status versions = all
17672024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/loopback-address versions = all
17682024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/loopback-address versions = all
17692024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
17702024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
17712024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/switch-port-settings versions = all
17722024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/switch-port-settings versions = all
17732024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
17742024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/policy versions = all
17752024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/policy versions = all
17762024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/roles versions = all
17772024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/roles/{role_name} versions = all
17782024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silo-quotas versions = all
17792024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos versions = all
17802024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/silos versions = all
17812024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/silos/{silo} versions = all
17822024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo} versions = all
17832024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
17842024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/policy versions = all
17852024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/silos/{silo}/policy versions = all
17862024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/quotas versions = all
17872024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
17882024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/timeseries/query versions = all
17892024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/timeseries/schemas versions = all
17902024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/update/repository versions = all
17912024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/update/repository/{system_version} versions = all
17922024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users versions = all
17932024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users/{user_id} versions = all
17942024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users-builtin versions = all
17952024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users-builtin/{user} versions = all
17962024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/utilization/silos versions = all
17972024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/utilization/silos/{silo} versions = all
17982024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/timeseries/query versions = all
17992024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/users versions = all
18002024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/utilization versions = all
18012024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-firewall-rules versions = all
18022024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-firewall-rules versions = all
18032024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-router-routes versions = all
18042024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-router-routes versions = all
18052024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
18062024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-router-routes/{route} versions = all
18072024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-router-routes/{route} versions = all
18082024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-routers versions = all
18092024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-routers versions = all
18102024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-routers/{router} versions = all
18112024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-routers/{router} versions = all
18122024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-routers/{router} versions = all
18132024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets versions = all
18142024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-subnets versions = all
18152024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
18162024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets/{subnet} versions = all
18172024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
18182024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
18192024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpcs versions = all
18202024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpcs versions = all
18212024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpcs/{vpc} versions = all
18222024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpcs/{vpc} versions = all
18232024-12-21T07:47:26.143ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpcs/{vpc} versions = all
18242024-12-21T07:47:26.144ZINFOnexus (dropshot_external): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = 172.30.2.6:443
18252024-12-21T07:47:26.144ZDEBGnexus (dropshot_external): successfully registered DTrace USDT probes local_addr = 172.30.2.6:443
18262024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = / versions = all
18272024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /access versions = all
18282024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /assets/{path} versions = all
18292024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/auth versions = all
18302024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/confirm versions = all
18312024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /device/success versions = all
18322024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/token versions = all
18332024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /device/verify versions = all
18342024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /experimental/v1/probes versions = all
18352024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /experimental/v1/probes versions = all
18362024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /experimental/v1/probes/{probe} versions = all
18372024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /experimental/v1/probes/{probe} versions = all
18382024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /images versions = all
18392024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login versions = all
18402024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/local versions = all
18412024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
18422024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
18432024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
18442024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /lookup/{path} versions = all
18452024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /projects/{path} versions = all
18462024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /projects-new versions = all
18472024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /settings/{path} versions = all
18482024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /system/{path} versions = all
18492024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /utilization versions = all
18502024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/certificates versions = all
18512024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/certificates versions = all
18522024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/certificates/{certificate} versions = all
18532024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/certificates/{certificate} versions = all
18542024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks versions = all
18552024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks versions = all
18562024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/disks/{disk} versions = all
18572024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks/{disk} versions = all
18582024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write versions = all
18592024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
18602024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
18612024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/finalize versions = all
18622024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
18632024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/floating-ips versions = all
18642024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips versions = all
18652024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
18662024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/floating-ips/{floating_ip} versions = all
18672024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
18682024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
18692024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
18702024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/groups versions = all
18712024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/groups/{group_id} versions = all
18722024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/images versions = all
18732024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images versions = all
18742024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/images/{image} versions = all
18752024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/images/{image} versions = all
18762024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images/{image}/demote versions = all
18772024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images/{image}/promote versions = all
18782024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances versions = all
18792024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances versions = all
18802024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/instances/{instance} versions = all
18812024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance} versions = all
18822024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/instances/{instance} versions = all
18832024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/disks versions = all
18842024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/disks/attach versions = all
18852024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/disks/detach versions = all
18862024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/external-ips versions = all
18872024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
18882024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
18892024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/reboot versions = all
18902024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/serial-console versions = all
18912024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
18922024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
18932024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/start versions = all
18942024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/stop versions = all
18952024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/internet-gateway-ip-addresses versions = all
18962024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/internet-gateway-ip-addresses versions = all
18972024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
18982024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/internet-gateway-ip-pools versions = all
18992024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/internet-gateway-ip-pools versions = all
19002024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
19012024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/internet-gateways versions = all
19022024-12-21T07:47:26.148ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/internet-gateways versions = all
19032024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
19042024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/internet-gateways/{gateway} versions = all
19052024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ip-pools versions = all
19062024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ip-pools/{pool} versions = all
19072024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/login/{silo_name}/local versions = all
19082024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/logout versions = all
19092024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me versions = all
19102024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/groups versions = all
19112024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/ssh-keys versions = all
19122024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/me/ssh-keys versions = all
19132024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
19142024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
19152024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/metrics/{metric_name} versions = all
19162024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/network-interfaces versions = all
19172024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/network-interfaces versions = all
19182024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/network-interfaces/{interface} versions = all
19192024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/network-interfaces/{interface} versions = all
19202024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/network-interfaces/{interface} versions = all
19212024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ping versions = all
19222024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/policy versions = all
19232024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/policy versions = all
19242024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects versions = all
19252024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/projects versions = all
19262024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/projects/{project} versions = all
19272024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects/{project} versions = all
19282024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/projects/{project} versions = all
19292024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects/{project}/policy versions = all
19302024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/projects/{project}/policy versions = all
19312024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/snapshots versions = all
19322024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/snapshots versions = all
19332024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/snapshots/{snapshot} versions = all
19342024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/snapshots/{snapshot} versions = all
19352024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/disks versions = all
19362024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
19372024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/racks versions = all
19382024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
19392024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds versions = all
19402024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/hardware/sleds versions = all
19412024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
19422024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
19432024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
19442024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
19452024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
19462024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switch-port versions = all
19472024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
19482024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
19492024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
19502024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switches versions = all
19512024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
19522024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/identity-providers versions = all
19532024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/local/users versions = all
19542024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
19552024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
19562024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/saml versions = all
19572024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
19582024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools versions = all
19592024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools versions = all
19602024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
19612024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool} versions = all
19622024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/ip-pools/{pool} versions = all
19632024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
19642024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
19652024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
19662024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
19672024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
19682024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
19692024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
19702024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
19712024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools-service versions = all
19722024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools-service/ranges versions = all
19732024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
19742024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
19752024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/metrics/{metric_name} versions = all
19762024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/address-lot versions = all
19772024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/address-lot versions = all
19782024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
19792024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
19802024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/allow-list versions = all
19812024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/networking/allow-list versions = all
19822024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bfd-disable versions = all
19832024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bfd-enable versions = all
19842024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bfd-status versions = all
19852024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/bgp versions = all
19862024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp versions = all
19872024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bgp versions = all
19882024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-announce-set versions = all
19892024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
19902024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
19912024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
19922024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-exported versions = all
19932024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-message-history versions = all
19942024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
19952024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-status versions = all
19962024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/loopback-address versions = all
19972024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/loopback-address versions = all
19982024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
19992024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
20002024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/switch-port-settings versions = all
20012024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/switch-port-settings versions = all
20022024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
20032024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/policy versions = all
20042024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/policy versions = all
20052024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/roles versions = all
20062024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/roles/{role_name} versions = all
20072024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silo-quotas versions = all
20082024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos versions = all
20092024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/silos versions = all
20102024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/silos/{silo} versions = all
20112024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo} versions = all
20122024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
20132024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/policy versions = all
20142024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/silos/{silo}/policy versions = all
20152024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/quotas versions = all
20162024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
20172024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/timeseries/query versions = all
20182024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/timeseries/schemas versions = all
20192024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/update/repository versions = all
20202024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/update/repository/{system_version} versions = all
20212024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users versions = all
20222024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users/{user_id} versions = all
20232024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users-builtin versions = all
20242024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users-builtin/{user} versions = all
20252024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/utilization/silos versions = all
20262024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/utilization/silos/{silo} versions = all
20272024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/timeseries/query versions = all
20282024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/users versions = all
20292024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/utilization versions = all
20302024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-firewall-rules versions = all
20312024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-firewall-rules versions = all
20322024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-router-routes versions = all
20332024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-router-routes versions = all
20342024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
20352024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-router-routes/{route} versions = all
20362024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-router-routes/{route} versions = all
20372024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-routers versions = all
20382024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-routers versions = all
20392024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-routers/{router} versions = all
20402024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-routers/{router} versions = all
20412024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-routers/{router} versions = all
20422024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets versions = all
20432024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-subnets versions = all
20442024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
20452024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets/{subnet} versions = all
20462024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
20472024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
20482024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpcs versions = all
20492024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpcs versions = all
20502024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpcs/{vpc} versions = all
20512024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpcs/{vpc} versions = all
20522024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpcs/{vpc} versions = all
20532024-12-21T07:47:26.149ZINFOnexus (dropshot_external_techport): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::b]:12228
20542024-12-21T07:47:26.149ZDEBGnexus (dropshot_external_techport): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:12228
20552024-12-21T07:47:26.150ZDEBGnexus (nexus-producer-server): registered DTrace probes
20562024-12-21T07:47:26.152ZDEBGnexus (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::b]:63928 method = GET path = /{producer_id} versions = all
20572024-12-21T07:47:26.153ZINFOnexus (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::b]:63928
20582024-12-21T07:47:26.153ZDEBGnexus (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:63928
20592024-12-21T07:47:26.153ZDEBGnexus (nexus-producer-server): Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::b]:63928
20602024-12-21T07:47:26.154ZDEBGnexus (nexus-producer-server): Nexus IP provided explicitly, will use it addr = [fd00:1122:3344:101::b]:12221
20612024-12-21T07:47:26.154ZDEBGnexus (nexus-producer-server): starting producer registration task
20622024-12-21T07:47:26.154ZINFOnexus (nexus-producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::b]:63928 file = oximeter/producer/src/lib.rs:279 interval = 10s producer_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
20632024-12-21T07:47:26.154ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
20642024-12-21T07:47:26.154ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
20652024-12-21T07:47:26.185ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
20662024-12-21T07:47:26.185ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:54276
20672024-12-21T07:47:26.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:54276 req_id = cd690d65-b08a-49f4-b062-cf3ed58fec09 roles = RoleSet { roles: {} } uri = /metrics/producers
20682024-12-21T07:47:26.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:54276 req_id = cd690d65-b08a-49f4-b062-cf3ed58fec09 resource = Database result = Ok(()) uri = /metrics/producers
20692024-12-21T07:47:26.191ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = a343033c-6f51-4865-a2d3-691517e8a95f file = nexus/db-queries/src/db/datastore/inventory.rs:1010
20702024-12-21T07:47:26.191ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = a343033c-6f51-4865-a2d3-691517e8a95f time_started = 2024-12-21 07:47:25.600592 UTC
20712024-12-21T07:47:26.191ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 639.174603ms iteration = 2 status = {"collection_id":"a343033c-6f51-4865-a2d3-691517e8a95f","time_done":"2024-12-21 07:47:25.886314 UTC","time_started":"2024-12-21 07:47:25.600592 UTC"}
20722024-12-21T07:47:26.191ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 3 reason = Dependency
20732024-12-21T07:47:26.191ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20742024-12-21T07:47:26.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20752024-12-21T07:47:26.192ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20762024-12-21T07:47:26.194ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20772024-12-21T07:47:26.194ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20782024-12-21T07:47:26.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20792024-12-21T07:47:26.197ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20802024-12-21T07:47:26.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20812024-12-21T07:47:26.199ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20822024-12-21T07:47:26.201ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20832024-12-21T07:47:26.201ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20842024-12-21T07:47:26.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20852024-12-21T07:47:26.233ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
20862024-12-21T07:47:26.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48241 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:54276 req_id = cd690d65-b08a-49f4-b062-cf3ed58fec09 response_code = 201 uri = /metrics/producers
20872024-12-21T07:47:26.234ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "cd690d65-b08a-49f4-b062-cf3ed58fec09", "content-length": "41", "date": "Sat, 21 Dec 2024 07:47:25 GMT"} })
20882024-12-21T07:47:26.235ZDEBGnexus (producer-registration-task): registered with nexus successfully
20892024-12-21T07:47:26.235ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
20902024-12-21T07:47:26.320ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 128.706128ms iteration = 3 status = {"physical_disks_added":0}
20912024-12-21T07:47:28.892ZDEBGnexus (NexusCertResolver): resolved TLS certificate certificate = TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" } server_name = recovery.sys.oxide.test silo_id = fe5ecf26-3a15-476c-b566-aba979f13c53
20922024-12-21T07:47:28.898ZINFOnexus (dropshot_external): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = 172.30.2.6:443 remote_addr = 10.151.1.100:64233
20932024-12-21T07:47:28.909ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20942024-12-21T07:47:28.910ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20952024-12-21T07:47:28.914ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20962024-12-21T07:47:28.915ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20972024-12-21T07:47:28.916ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20982024-12-21T07:47:28.916ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20992024-12-21T07:47:28.918ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21002024-12-21T07:47:28.919ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ByName("recovery") } result = Ok(())
21012024-12-21T07:47:28.919ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21022024-12-21T07:47:28.919ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21032024-12-21T07:47:28.921ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21042024-12-21T07:47:28.921ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21052024-12-21T07:47:28.923ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21062024-12-21T07:47:28.925ZDEBGnexus (ExternalAuthn): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ByName("recovery") } result = Ok(())
21072024-12-21T07:47:28.925ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21082024-12-21T07:47:28.925ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21092024-12-21T07:47:28.936ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21102024-12-21T07:47:28.936ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21112024-12-21T07:47:28.938ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21122024-12-21T07:47:28.938ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21132024-12-21T07:47:28.939ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21142024-12-21T07:47:28.941ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ByName("recovery") }, key: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, lookup_type: ByName("recovery") } result = Ok(())
21152024-12-21T07:47:28.941ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21162024-12-21T07:47:28.941ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21172024-12-21T07:47:29.636ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21182024-12-21T07:47:29.636ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21192024-12-21T07:47:29.638ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21202024-12-21T07:47:29.638ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21212024-12-21T07:47:29.640ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21222024-12-21T07:47:29.641ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21232024-12-21T07:47:29.642ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21242024-12-21T07:47:29.642ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21252024-12-21T07:47:29.643ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21262024-12-21T07:47:29.645ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, lookup_type: ById(1a51fb95-9352-4c8d-9e2d-5b672a14624e) } result = Ok(())
21272024-12-21T07:47:29.645ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21282024-12-21T07:47:29.645ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21292024-12-21T07:47:29.646ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21302024-12-21T07:47:29.648ZDEBGnexus (ExternalAuthn): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSessionList result = Ok(())
21312024-12-21T07:47:29.648ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21322024-12-21T07:47:29.648ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21332024-12-21T07:47:29.659ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 753726 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:64233 req_id = 45aa67b8-f485-4bff-8618-4e818b80e2ce response_code = 204 uri = /v1/login/recovery/local
21342024-12-21T07:47:29.697ZDEBGnexus (NexusCertResolver): resolved TLS certificate certificate = TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" } server_name = recovery.sys.oxide.test silo_id = fe5ecf26-3a15-476c-b566-aba979f13c53
21352024-12-21T07:47:29.702ZINFOnexus (dropshot_external): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = 172.30.2.6:443 remote_addr = 10.151.1.100:56045
21362024-12-21T07:47:29.703ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21372024-12-21T07:47:29.704ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21382024-12-21T07:47:29.712ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21392024-12-21T07:47:29.712ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21402024-12-21T07:47:29.713ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21412024-12-21T07:47:29.714ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9b209be00ecb321a38c92e6ec4fe4002342d4be6", lookup_type: ByCompositeId("token = \\"9b209be00ecb321a38c92e6ec4fe4002342d4be6\\"") } result = Ok(())
21422024-12-21T07:47:29.714ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21432024-12-21T07:47:29.714ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21442024-12-21T07:47:29.716ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21452024-12-21T07:47:29.716ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21462024-12-21T07:47:29.718ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21472024-12-21T07:47:29.718ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21482024-12-21T07:47:29.719ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21492024-12-21T07:47:29.719ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21502024-12-21T07:47:29.721ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21512024-12-21T07:47:29.722ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, lookup_type: ById(1a51fb95-9352-4c8d-9e2d-5b672a14624e) } result = Ok(())
21522024-12-21T07:47:29.722ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21532024-12-21T07:47:29.722ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21542024-12-21T07:47:29.723ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21552024-12-21T07:47:29.724ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9b209be00ecb321a38c92e6ec4fe4002342d4be6", lookup_type: ByCompositeId("9b209be00ecb321a38c92e6ec4fe4002342d4be6") } result = Ok(())
21562024-12-21T07:47:29.724ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21572024-12-21T07:47:29.724ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21582024-12-21T07:47:29.731ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21592024-12-21T07:47:29.732ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21602024-12-21T07:47:29.733ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21612024-12-21T07:47:29.733ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21622024-12-21T07:47:29.735ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21632024-12-21T07:47:29.735ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21642024-12-21T07:47:29.736ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21652024-12-21T07:47:29.736ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21662024-12-21T07:47:29.737ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21672024-12-21T07:47:29.738ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, lookup_type: ById(1a51fb95-9352-4c8d-9e2d-5b672a14624e) } result = Ok(())
21682024-12-21T07:47:29.738ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21692024-12-21T07:47:29.738ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21702024-12-21T07:47:29.744ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21712024-12-21T07:47:29.744ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21722024-12-21T07:47:29.745ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21732024-12-21T07:47:29.745ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21742024-12-21T07:47:29.747ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21752024-12-21T07:47:29.748ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) } result = Ok(())
21762024-12-21T07:47:29.748ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.1.100:56045 req_id = bacfdc9d-7937-4892-8e26-8cb1336e6c80 roles = RoleSet { roles: {} } uri = /v1/projects
21772024-12-21T07:47:29.749ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.1.100:56045 req_id = bacfdc9d-7937-4892-8e26-8cb1336e6c80 resource = Database result = Ok(()) uri = /v1/projects
21782024-12-21T07:47:29.758ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.1.100:56045 req_id = bacfdc9d-7937-4892-8e26-8cb1336e6c80 roles = RoleSet { roles: {} } uri = /v1/projects
21792024-12-21T07:47:29.758ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.1.100:56045 req_id = bacfdc9d-7937-4892-8e26-8cb1336e6c80 resource = Database result = Ok(()) uri = /v1/projects
21802024-12-21T07:47:29.770ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.1.100:56045 req_id = bacfdc9d-7937-4892-8e26-8cb1336e6c80 roles = RoleSet { roles: {} } uri = /v1/projects
21812024-12-21T07:47:29.770ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.1.100:56045 req_id = bacfdc9d-7937-4892-8e26-8cb1336e6c80 resource = Database result = Ok(()) uri = /v1/projects
21822024-12-21T07:47:29.780ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.1.100:56045 req_id = bacfdc9d-7937-4892-8e26-8cb1336e6c80 roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } uri = /v1/projects
21832024-12-21T07:47:29.781ZDEBGnexus (dropshot_external): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.1.100:56045 req_id = bacfdc9d-7937-4892-8e26-8cb1336e6c80 resource = Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) } result = Ok(()) uri = /v1/projects
21842024-12-21T07:47:29.781ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.1.100:56045 req_id = bacfdc9d-7937-4892-8e26-8cb1336e6c80 roles = RoleSet { roles: {} } uri = /v1/projects
21852024-12-21T07:47:29.781ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.1.100:56045 req_id = bacfdc9d-7937-4892-8e26-8cb1336e6c80 resource = Database result = Ok(()) uri = /v1/projects
21862024-12-21T07:47:29.783ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80679 local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.1.100:56045 req_id = bacfdc9d-7937-4892-8e26-8cb1336e6c80 response_code = 200 uri = /v1/projects
21872024-12-21T07:47:29.788ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21882024-12-21T07:47:29.789ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21892024-12-21T07:47:29.790ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21902024-12-21T07:47:29.790ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21912024-12-21T07:47:29.792ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21922024-12-21T07:47:29.793ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9b209be00ecb321a38c92e6ec4fe4002342d4be6", lookup_type: ByCompositeId("token = \\"9b209be00ecb321a38c92e6ec4fe4002342d4be6\\"") } result = Ok(())
21932024-12-21T07:47:29.793ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21942024-12-21T07:47:29.793ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21952024-12-21T07:47:29.795ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21962024-12-21T07:47:29.795ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21972024-12-21T07:47:29.797ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21982024-12-21T07:47:29.797ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21992024-12-21T07:47:29.798ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22002024-12-21T07:47:29.798ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22012024-12-21T07:47:29.799ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22022024-12-21T07:47:29.801ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, lookup_type: ById(1a51fb95-9352-4c8d-9e2d-5b672a14624e) } result = Ok(())
22032024-12-21T07:47:29.801ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22042024-12-21T07:47:29.801ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22052024-12-21T07:47:29.802ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22062024-12-21T07:47:29.803ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9b209be00ecb321a38c92e6ec4fe4002342d4be6", lookup_type: ByCompositeId("9b209be00ecb321a38c92e6ec4fe4002342d4be6") } result = Ok(())
22072024-12-21T07:47:29.803ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22082024-12-21T07:47:29.803ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22092024-12-21T07:47:29.819ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22102024-12-21T07:47:29.819ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22112024-12-21T07:47:29.820ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22122024-12-21T07:47:29.820ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22132024-12-21T07:47:29.822ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22142024-12-21T07:47:29.822ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22152024-12-21T07:47:29.823ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22162024-12-21T07:47:29.823ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22172024-12-21T07:47:29.825ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22182024-12-21T07:47:29.826ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, lookup_type: ById(1a51fb95-9352-4c8d-9e2d-5b672a14624e) } result = Ok(())
22192024-12-21T07:47:29.826ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22202024-12-21T07:47:29.826ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22212024-12-21T07:47:29.827ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22222024-12-21T07:47:29.828ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22232024-12-21T07:47:29.829ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22242024-12-21T07:47:29.829ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22252024-12-21T07:47:29.830ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22262024-12-21T07:47:29.832ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) } result = Ok(())
22272024-12-21T07:47:29.832ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7a4a6adf-91b3-4203-b95d-bcc8c04ea461 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools
22282024-12-21T07:47:29.832ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7a4a6adf-91b3-4203-b95d-bcc8c04ea461 resource = Database result = Ok(()) uri = /v1/system/ip-pools
22292024-12-21T07:47:29.843ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7a4a6adf-91b3-4203-b95d-bcc8c04ea461 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools
22302024-12-21T07:47:29.843ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7a4a6adf-91b3-4203-b95d-bcc8c04ea461 resource = Database result = Ok(()) uri = /v1/system/ip-pools
22312024-12-21T07:47:29.845ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7a4a6adf-91b3-4203-b95d-bcc8c04ea461 roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } uri = /v1/system/ip-pools
22322024-12-21T07:47:29.847ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7a4a6adf-91b3-4203-b95d-bcc8c04ea461 resource = IpPoolList result = Ok(()) uri = /v1/system/ip-pools
22332024-12-21T07:47:29.847ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7a4a6adf-91b3-4203-b95d-bcc8c04ea461 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools
22342024-12-21T07:47:29.847ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7a4a6adf-91b3-4203-b95d-bcc8c04ea461 resource = Database result = Ok(()) uri = /v1/system/ip-pools
22352024-12-21T07:47:29.853ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65170 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7a4a6adf-91b3-4203-b95d-bcc8c04ea461 response_code = 201 uri = /v1/system/ip-pools
22362024-12-21T07:47:29.856ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22372024-12-21T07:47:29.856ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22382024-12-21T07:47:29.858ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22392024-12-21T07:47:29.858ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22402024-12-21T07:47:29.860ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22412024-12-21T07:47:29.861ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9b209be00ecb321a38c92e6ec4fe4002342d4be6", lookup_type: ByCompositeId("token = \\"9b209be00ecb321a38c92e6ec4fe4002342d4be6\\"") } result = Ok(())
22422024-12-21T07:47:29.861ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22432024-12-21T07:47:29.861ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22442024-12-21T07:47:29.862ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22452024-12-21T07:47:29.863ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22462024-12-21T07:47:29.864ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22472024-12-21T07:47:29.864ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22482024-12-21T07:47:29.865ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22492024-12-21T07:47:29.865ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22502024-12-21T07:47:29.867ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22512024-12-21T07:47:29.868ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, lookup_type: ById(1a51fb95-9352-4c8d-9e2d-5b672a14624e) } result = Ok(())
22522024-12-21T07:47:29.868ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22532024-12-21T07:47:29.868ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22542024-12-21T07:47:29.870ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22552024-12-21T07:47:29.871ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9b209be00ecb321a38c92e6ec4fe4002342d4be6", lookup_type: ByCompositeId("9b209be00ecb321a38c92e6ec4fe4002342d4be6") } result = Ok(())
22562024-12-21T07:47:29.871ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22572024-12-21T07:47:29.871ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22582024-12-21T07:47:29.875ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22592024-12-21T07:47:29.875ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22602024-12-21T07:47:29.877ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22612024-12-21T07:47:29.877ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22622024-12-21T07:47:29.878ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22632024-12-21T07:47:29.878ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22642024-12-21T07:47:29.879ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22652024-12-21T07:47:29.880ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22662024-12-21T07:47:29.881ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22672024-12-21T07:47:29.882ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, lookup_type: ById(1a51fb95-9352-4c8d-9e2d-5b672a14624e) } result = Ok(())
22682024-12-21T07:47:29.882ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22692024-12-21T07:47:29.882ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22702024-12-21T07:47:29.884ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22712024-12-21T07:47:29.884ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22722024-12-21T07:47:29.885ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22732024-12-21T07:47:29.886ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22742024-12-21T07:47:29.887ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22752024-12-21T07:47:29.888ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) } result = Ok(())
22762024-12-21T07:47:29.888ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 06a06611-e3e4-42e9-8b52-6709be8d10e3 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22772024-12-21T07:47:29.889ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 06a06611-e3e4-42e9-8b52-6709be8d10e3 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
22782024-12-21T07:47:29.891ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 06a06611-e3e4-42e9-8b52-6709be8d10e3 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22792024-12-21T07:47:29.891ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 06a06611-e3e4-42e9-8b52-6709be8d10e3 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
22802024-12-21T07:47:29.904ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 06a06611-e3e4-42e9-8b52-6709be8d10e3 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22812024-12-21T07:47:29.904ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 06a06611-e3e4-42e9-8b52-6709be8d10e3 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
22822024-12-21T07:47:29.907ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 06a06611-e3e4-42e9-8b52-6709be8d10e3 roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } uri = /v1/system/ip-pools/default/silos
22832024-12-21T07:47:29.909ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 06a06611-e3e4-42e9-8b52-6709be8d10e3 resource = IpPool { parent: Fleet, key: 69b89fb4-6757-4ff5-aa3b-b35339a5382e, lookup_type: ByName("default") } result = Ok(()) uri = /v1/system/ip-pools/default/silos
22842024-12-21T07:47:29.909ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 06a06611-e3e4-42e9-8b52-6709be8d10e3 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22852024-12-21T07:47:29.909ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 06a06611-e3e4-42e9-8b52-6709be8d10e3 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
22862024-12-21T07:47:29.919ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 06a06611-e3e4-42e9-8b52-6709be8d10e3 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22872024-12-21T07:47:29.919ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 06a06611-e3e4-42e9-8b52-6709be8d10e3 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
22882024-12-21T07:47:29.921ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 06a06611-e3e4-42e9-8b52-6709be8d10e3 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22892024-12-21T07:47:29.921ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 06a06611-e3e4-42e9-8b52-6709be8d10e3 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
22902024-12-21T07:47:29.924ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 06a06611-e3e4-42e9-8b52-6709be8d10e3 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22912024-12-21T07:47:29.924ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 06a06611-e3e4-42e9-8b52-6709be8d10e3 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
22922024-12-21T07:47:29.926ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 06a06611-e3e4-42e9-8b52-6709be8d10e3 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22932024-12-21T07:47:29.927ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 06a06611-e3e4-42e9-8b52-6709be8d10e3 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
22942024-12-21T07:47:29.930ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 06a06611-e3e4-42e9-8b52-6709be8d10e3 roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } uri = /v1/system/ip-pools/default/silos
22952024-12-21T07:47:29.931ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 06a06611-e3e4-42e9-8b52-6709be8d10e3 resource = Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ByName("recovery") } result = Ok(()) uri = /v1/system/ip-pools/default/silos
22962024-12-21T07:47:29.931ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 06a06611-e3e4-42e9-8b52-6709be8d10e3 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22972024-12-21T07:47:29.931ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 06a06611-e3e4-42e9-8b52-6709be8d10e3 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
22982024-12-21T07:47:29.933ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 06a06611-e3e4-42e9-8b52-6709be8d10e3 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22992024-12-21T07:47:29.934ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 06a06611-e3e4-42e9-8b52-6709be8d10e3 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
23002024-12-21T07:47:29.935ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 06a06611-e3e4-42e9-8b52-6709be8d10e3 roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } uri = /v1/system/ip-pools/default/silos
23012024-12-21T07:47:29.937ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 06a06611-e3e4-42e9-8b52-6709be8d10e3 resource = IpPoolList result = Ok(()) uri = /v1/system/ip-pools/default/silos
23022024-12-21T07:47:29.937ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 06a06611-e3e4-42e9-8b52-6709be8d10e3 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
23032024-12-21T07:47:29.937ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 06a06611-e3e4-42e9-8b52-6709be8d10e3 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
23042024-12-21T07:47:29.997ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141785 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 06a06611-e3e4-42e9-8b52-6709be8d10e3 response_code = 201 uri = /v1/system/ip-pools/default/silos
23052024-12-21T07:47:29.999ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23062024-12-21T07:47:30.000ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23072024-12-21T07:47:30.023ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23082024-12-21T07:47:30.023ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23092024-12-21T07:47:30.024ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23102024-12-21T07:47:30.026ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9b209be00ecb321a38c92e6ec4fe4002342d4be6", lookup_type: ByCompositeId("token = \\"9b209be00ecb321a38c92e6ec4fe4002342d4be6\\"") } result = Ok(())
23112024-12-21T07:47:30.026ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23122024-12-21T07:47:30.026ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23132024-12-21T07:47:30.027ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23142024-12-21T07:47:30.028ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23152024-12-21T07:47:30.029ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23162024-12-21T07:47:30.029ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23172024-12-21T07:47:30.031ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23182024-12-21T07:47:30.031ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23192024-12-21T07:47:30.032ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23202024-12-21T07:47:30.033ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, lookup_type: ById(1a51fb95-9352-4c8d-9e2d-5b672a14624e) } result = Ok(())
23212024-12-21T07:47:30.033ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23222024-12-21T07:47:30.034ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23232024-12-21T07:47:30.035ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23242024-12-21T07:47:30.036ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9b209be00ecb321a38c92e6ec4fe4002342d4be6", lookup_type: ByCompositeId("9b209be00ecb321a38c92e6ec4fe4002342d4be6") } result = Ok(())
23252024-12-21T07:47:30.036ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23262024-12-21T07:47:30.036ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23272024-12-21T07:47:30.045ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23282024-12-21T07:47:30.045ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23292024-12-21T07:47:30.046ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23302024-12-21T07:47:30.046ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23312024-12-21T07:47:30.048ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23322024-12-21T07:47:30.048ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23332024-12-21T07:47:30.049ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23342024-12-21T07:47:30.050ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23352024-12-21T07:47:30.051ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23362024-12-21T07:47:30.052ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, lookup_type: ById(1a51fb95-9352-4c8d-9e2d-5b672a14624e) } result = Ok(())
23372024-12-21T07:47:30.052ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23382024-12-21T07:47:30.052ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23392024-12-21T07:47:30.054ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23402024-12-21T07:47:30.054ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23412024-12-21T07:47:30.055ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23422024-12-21T07:47:30.055ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23432024-12-21T07:47:30.056ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23442024-12-21T07:47:30.057ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) } result = Ok(())
23452024-12-21T07:47:30.057ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 407035a1-3637-4a55-aa63-b1bcda7a0981 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
23462024-12-21T07:47:30.058ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 407035a1-3637-4a55-aa63-b1bcda7a0981 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
23472024-12-21T07:47:30.060ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 407035a1-3637-4a55-aa63-b1bcda7a0981 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
23482024-12-21T07:47:30.060ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 407035a1-3637-4a55-aa63-b1bcda7a0981 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
23492024-12-21T07:47:30.062ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 407035a1-3637-4a55-aa63-b1bcda7a0981 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
23502024-12-21T07:47:30.062ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 407035a1-3637-4a55-aa63-b1bcda7a0981 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
23512024-12-21T07:47:30.065ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 407035a1-3637-4a55-aa63-b1bcda7a0981 roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } uri = /v1/system/ip-pools/default/ranges/add
23522024-12-21T07:47:30.067ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 407035a1-3637-4a55-aa63-b1bcda7a0981 resource = IpPool { parent: Fleet, key: 69b89fb4-6757-4ff5-aa3b-b35339a5382e, lookup_type: ByName("default") } result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
23532024-12-21T07:47:30.067ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 407035a1-3637-4a55-aa63-b1bcda7a0981 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
23542024-12-21T07:47:30.067ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 407035a1-3637-4a55-aa63-b1bcda7a0981 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
23552024-12-21T07:47:30.068ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 407035a1-3637-4a55-aa63-b1bcda7a0981 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
23562024-12-21T07:47:30.068ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 407035a1-3637-4a55-aa63-b1bcda7a0981 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
23572024-12-21T07:47:30.069ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 407035a1-3637-4a55-aa63-b1bcda7a0981 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
23582024-12-21T07:47:30.069ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 407035a1-3637-4a55-aa63-b1bcda7a0981 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
23592024-12-21T07:47:30.072ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 407035a1-3637-4a55-aa63-b1bcda7a0981 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
23602024-12-21T07:47:30.072ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 407035a1-3637-4a55-aa63-b1bcda7a0981 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
23612024-12-21T07:47:30.074ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 407035a1-3637-4a55-aa63-b1bcda7a0981 roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } uri = /v1/system/ip-pools/default/ranges/add
23622024-12-21T07:47:30.075ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 407035a1-3637-4a55-aa63-b1bcda7a0981 resource = IpPool { parent: Fleet, key: 69b89fb4-6757-4ff5-aa3b-b35339a5382e, lookup_type: ByName("default") } result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
23632024-12-21T07:47:30.093ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94614 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 407035a1-3637-4a55-aa63-b1bcda7a0981 response_code = 201 uri = /v1/system/ip-pools/default/ranges/add
23642024-12-21T07:47:30.096ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23652024-12-21T07:47:30.096ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23662024-12-21T07:47:30.097ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23672024-12-21T07:47:30.097ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23682024-12-21T07:47:30.099ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23692024-12-21T07:47:30.100ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9b209be00ecb321a38c92e6ec4fe4002342d4be6", lookup_type: ByCompositeId("token = \\"9b209be00ecb321a38c92e6ec4fe4002342d4be6\\"") } result = Ok(())
23702024-12-21T07:47:30.100ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23712024-12-21T07:47:30.100ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23722024-12-21T07:47:30.101ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23732024-12-21T07:47:30.102ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23742024-12-21T07:47:30.103ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23752024-12-21T07:47:30.103ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23762024-12-21T07:47:30.105ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23772024-12-21T07:47:30.105ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23782024-12-21T07:47:30.106ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23792024-12-21T07:47:30.107ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, lookup_type: ById(1a51fb95-9352-4c8d-9e2d-5b672a14624e) } result = Ok(())
23802024-12-21T07:47:30.107ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23812024-12-21T07:47:30.108ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23822024-12-21T07:47:30.109ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23832024-12-21T07:47:30.110ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9b209be00ecb321a38c92e6ec4fe4002342d4be6", lookup_type: ByCompositeId("9b209be00ecb321a38c92e6ec4fe4002342d4be6") } result = Ok(())
23842024-12-21T07:47:30.110ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23852024-12-21T07:47:30.110ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23862024-12-21T07:47:30.113ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23872024-12-21T07:47:30.113ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23882024-12-21T07:47:30.115ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23892024-12-21T07:47:30.115ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23902024-12-21T07:47:30.116ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23912024-12-21T07:47:30.116ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23922024-12-21T07:47:30.118ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23932024-12-21T07:47:30.118ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23942024-12-21T07:47:30.119ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23952024-12-21T07:47:30.120ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, lookup_type: ById(1a51fb95-9352-4c8d-9e2d-5b672a14624e) } result = Ok(())
23962024-12-21T07:47:30.120ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23972024-12-21T07:47:30.120ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23982024-12-21T07:47:30.121ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23992024-12-21T07:47:30.121ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24002024-12-21T07:47:30.123ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24012024-12-21T07:47:30.123ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24022024-12-21T07:47:30.124ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24032024-12-21T07:47:30.125ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) } result = Ok(())
24042024-12-21T07:47:30.125ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56045 req_id = 6746d52c-145e-49bc-80b1-190fc9f43fb1 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
24052024-12-21T07:47:30.126ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56045 req_id = 6746d52c-145e-49bc-80b1-190fc9f43fb1 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
24062024-12-21T07:47:30.127ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56045 req_id = 6746d52c-145e-49bc-80b1-190fc9f43fb1 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
24072024-12-21T07:47:30.127ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56045 req_id = 6746d52c-145e-49bc-80b1-190fc9f43fb1 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
24082024-12-21T07:47:30.129ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56045 req_id = 6746d52c-145e-49bc-80b1-190fc9f43fb1 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
24092024-12-21T07:47:30.129ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56045 req_id = 6746d52c-145e-49bc-80b1-190fc9f43fb1 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
24102024-12-21T07:47:30.132ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56045 req_id = 6746d52c-145e-49bc-80b1-190fc9f43fb1 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
24112024-12-21T07:47:30.132ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56045 req_id = 6746d52c-145e-49bc-80b1-190fc9f43fb1 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
24122024-12-21T07:47:30.134ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56045 req_id = 6746d52c-145e-49bc-80b1-190fc9f43fb1 roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } uri = /v1/system/silos/recovery/quotas
24132024-12-21T07:47:30.135ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:62166
24142024-12-21T07:47:30.136ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56045 req_id = 6746d52c-145e-49bc-80b1-190fc9f43fb1 resource = Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ByName("recovery") } result = Ok(()) uri = /v1/system/silos/recovery/quotas
24152024-12-21T07:47:30.136ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56045 req_id = 6746d52c-145e-49bc-80b1-190fc9f43fb1 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
24162024-12-21T07:47:30.136ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56045 req_id = 6746d52c-145e-49bc-80b1-190fc9f43fb1 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
24172024-12-21T07:47:30.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = c9b2ed93-e284-4f08-8199-b5b475f1c5c4 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
24182024-12-21T07:47:30.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = c9b2ed93-e284-4f08-8199-b5b475f1c5c4 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
24192024-12-21T07:47:30.138ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56045 req_id = 6746d52c-145e-49bc-80b1-190fc9f43fb1 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
24202024-12-21T07:47:30.138ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56045 req_id = 6746d52c-145e-49bc-80b1-190fc9f43fb1 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
24212024-12-21T07:47:30.140ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56045 req_id = 6746d52c-145e-49bc-80b1-190fc9f43fb1 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
24222024-12-21T07:47:30.140ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56045 req_id = 6746d52c-145e-49bc-80b1-190fc9f43fb1 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
24232024-12-21T07:47:30.151ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56045 req_id = 6746d52c-145e-49bc-80b1-190fc9f43fb1 roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } uri = /v1/system/silos/recovery/quotas
24242024-12-21T07:47:30.152ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56045 req_id = 6746d52c-145e-49bc-80b1-190fc9f43fb1 resource = Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ByName("recovery") } result = Ok(()) uri = /v1/system/silos/recovery/quotas
24252024-12-21T07:47:30.152ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56045 req_id = 6746d52c-145e-49bc-80b1-190fc9f43fb1 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
24262024-12-21T07:47:30.152ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56045 req_id = 6746d52c-145e-49bc-80b1-190fc9f43fb1 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
24272024-12-21T07:47:30.157ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61619 local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56045 req_id = 6746d52c-145e-49bc-80b1-190fc9f43fb1 response_code = 200 uri = /v1/system/silos/recovery/quotas
24282024-12-21T07:47:30.159ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24292024-12-21T07:47:30.159ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24302024-12-21T07:47:30.160ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24312024-12-21T07:47:30.160ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24322024-12-21T07:47:30.162ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24332024-12-21T07:47:30.163ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9b209be00ecb321a38c92e6ec4fe4002342d4be6", lookup_type: ByCompositeId("token = \\"9b209be00ecb321a38c92e6ec4fe4002342d4be6\\"") } result = Ok(())
24342024-12-21T07:47:30.163ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24352024-12-21T07:47:30.163ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24362024-12-21T07:47:30.164ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24372024-12-21T07:47:30.165ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24382024-12-21T07:47:30.166ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24392024-12-21T07:47:30.166ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24402024-12-21T07:47:30.168ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24412024-12-21T07:47:30.168ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24422024-12-21T07:47:30.169ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24432024-12-21T07:47:30.170ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, lookup_type: ById(1a51fb95-9352-4c8d-9e2d-5b672a14624e) } result = Ok(())
24442024-12-21T07:47:30.170ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24452024-12-21T07:47:30.171ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24462024-12-21T07:47:30.172ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24472024-12-21T07:47:30.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34225 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = c9b2ed93-e284-4f08-8199-b5b475f1c5c4 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
24482024-12-21T07:47:30.173ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9b209be00ecb321a38c92e6ec4fe4002342d4be6", lookup_type: ByCompositeId("9b209be00ecb321a38c92e6ec4fe4002342d4be6") } result = Ok(())
24492024-12-21T07:47:30.173ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24502024-12-21T07:47:30.173ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24512024-12-21T07:47:30.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 36cbb470-afd9-4c63-bea6-94b3b9e099d5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
24522024-12-21T07:47:30.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 36cbb470-afd9-4c63-bea6-94b3b9e099d5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
24532024-12-21T07:47:30.177ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24542024-12-21T07:47:30.177ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24552024-12-21T07:47:30.178ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24562024-12-21T07:47:30.178ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24572024-12-21T07:47:30.180ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24582024-12-21T07:47:30.180ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24592024-12-21T07:47:30.181ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24602024-12-21T07:47:30.181ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24612024-12-21T07:47:30.182ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24622024-12-21T07:47:30.184ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, lookup_type: ById(1a51fb95-9352-4c8d-9e2d-5b672a14624e) } result = Ok(())
24632024-12-21T07:47:30.184ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24642024-12-21T07:47:30.184ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24652024-12-21T07:47:30.186ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24662024-12-21T07:47:30.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10923 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 36cbb470-afd9-4c63-bea6-94b3b9e099d5 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
24672024-12-21T07:47:30.186ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24682024-12-21T07:47:30.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 1bc898b7-90a5-412a-a9ec-ac763c6f3414 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
24692024-12-21T07:47:30.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 1bc898b7-90a5-412a-a9ec-ac763c6f3414 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
24702024-12-21T07:47:30.187ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24712024-12-21T07:47:30.187ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24722024-12-21T07:47:30.189ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24732024-12-21T07:47:30.190ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) } result = Ok(())
24742024-12-21T07:47:30.190ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = b08becb2-fc05-4adc-9427-e8645af0772a roles = RoleSet { roles: {} } uri = /v1/projects
24752024-12-21T07:47:30.190ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = b08becb2-fc05-4adc-9427-e8645af0772a resource = Database result = Ok(()) uri = /v1/projects
24762024-12-21T07:47:30.192ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = b08becb2-fc05-4adc-9427-e8645af0772a roles = RoleSet { roles: {} } uri = /v1/projects
24772024-12-21T07:47:30.192ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = b08becb2-fc05-4adc-9427-e8645af0772a resource = Database result = Ok(()) uri = /v1/projects
24782024-12-21T07:47:30.194ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = b08becb2-fc05-4adc-9427-e8645af0772a roles = RoleSet { roles: {} } uri = /v1/projects
24792024-12-21T07:47:30.195ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = b08becb2-fc05-4adc-9427-e8645af0772a resource = Database result = Ok(()) uri = /v1/projects
24802024-12-21T07:47:30.197ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = b08becb2-fc05-4adc-9427-e8645af0772a roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } uri = /v1/projects
24812024-12-21T07:47:30.198ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = b08becb2-fc05-4adc-9427-e8645af0772a resource = Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) } result = Ok(()) uri = /v1/projects
24822024-12-21T07:47:30.199ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create
24832024-12-21T07:47:30.199ZINFOnexus (SEC): saga create dag = {"end_node":19,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[8,9,null],[9,10,null],[10,11,null],[11,12,null],[12,13,null],[13,14,null],[14,15,null],[15,16,null],[2,3,null],[16,17,null],[18,0,null],[17,19,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"project_create.project_create_record","label":"ProjectCreateRecord","name":"project"}},{"Action":{"action_name":"project_create.project_create_vpc_params","label":"ProjectCreateVpcParams","name":"vpc_create_params"}},{"SubsagaStart":{"params_node_name":"vpc_create_params","saga_name":"vpc-create"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateVpcId","name":"vpc_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateSystemRouterId","name":"system_router_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultV4RouteId","name":"default_v4_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultV6RouteId","name":"default_v6_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultSubnetId","name":"default_subnet_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultInternetGatewayId","name":"default_internet_gateway_id"}},{"Action":{"action_name":"vpc_create.vpc_create_vpc","label":"VpcCreateVpc","name":"vpc"}},{"Action":{"action_name":"vpc_create.vpc_create_router","label":"VpcCreateRouter","name":"router"}},{"Action":{"action_name":"vpc_create.vpc_create_v4_route","label":"VpcCreateV4Route","name":"route4"}},{"Action":{"action_name":"vpc_create.vpc_create_v6_route","label":"VpcCreateV6Route","name":"route6"}},{"Action":{"action_name":"vpc_create.vpc_create_subnet","label":"VpcCreateSubnet","name":"subnet"}},{"Action":{"action_name":"vpc_create.vpc_update_firewall","label":"VpcUpdateFirewall","name":"firewall"}},{"Action":{"action_name":"vpc_create.vpc_create_gateway","label":"VpcCreateGateway","name":"gateway"}},{"Action":{"action_name":"vpc_create.vpc_notify_sleds","label":"VpcNotifySleds","name":"no_result"}},{"SubsagaEnd":{"name":"vpc"}},{"Start":{"params":{"authz_silo":{"key":"fe5ecf26-3a15-476c-b566-aba979f13c53","lookup_type":{"ById":"fe5ecf26-3a15-476c-b566-aba979f13c53"},"parent":null},"project_create":{"description":"","name":"proj-666b25e00f1"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","silo_user_id":"1a51fb95-9352-4c8d-9e2d-5b672a14624e"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"project-create","start_node":18} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
24842024-12-21T07:47:30.199ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create
24852024-12-21T07:47:30.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 17118 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 1bc898b7-90a5-412a-a9ec-ac763c6f3414 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
24862024-12-21T07:47:30.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 3139c24b-9b2d-4d1a-ba85-bda70f420714 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
24872024-12-21T07:47:30.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 3139c24b-9b2d-4d1a-ba85-bda70f420714 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
24882024-12-21T07:47:30.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3092 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 3139c24b-9b2d-4d1a-ba85-bda70f420714 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
24892024-12-21T07:47:30.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 717306c7-eaba-4696-8048-6b35afc185f8 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
24902024-12-21T07:47:30.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 717306c7-eaba-4696-8048-6b35afc185f8 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
24912024-12-21T07:47:30.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 15606 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 717306c7-eaba-4696-8048-6b35afc185f8 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
24922024-12-21T07:47:30.267ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create
24932024-12-21T07:47:30.267ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
24942024-12-21T07:47:30.267ZDEBGnexus (SEC): saga log event new_state = N018 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
24952024-12-21T07:47:30.267ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 18 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
24962024-12-21T07:47:30.275ZDEBGnexus (SEC): saga log event new_state = N018 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
24972024-12-21T07:47:30.275ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 18 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
24982024-12-21T07:47:30.285ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
24992024-12-21T07:47:30.285ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
25002024-12-21T07:47:30.302ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = ProjectCreateRecord
25012024-12-21T07:47:30.302ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = ProjectCreateRecord
25022024-12-21T07:47:30.306ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = ProjectCreateRecord
25032024-12-21T07:47:30.306ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = ProjectCreateRecord
25042024-12-21T07:47:30.308ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = ProjectCreateRecord
25052024-12-21T07:47:30.308ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = ProjectCreateRecord
25062024-12-21T07:47:30.310ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = ProjectCreateRecord
25072024-12-21T07:47:30.312ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) } result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = ProjectCreateRecord
25082024-12-21T07:47:30.312ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = ProjectCreateRecord
25092024-12-21T07:47:30.312ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = ProjectCreateRecord
25102024-12-21T07:47:30.322ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
25112024-12-21T07:47:30.322ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("421b8a93-e2b9-43df-aa9a-1d075e1831e7"), "lookup_type": Object {"ByName": String("proj-666b25e00f1")}, "parent": Object {"key": String("fe5ecf26-3a15-476c-b566-aba979f13c53"), "lookup_type": Object {"ById": String("fe5ecf26-3a15-476c-b566-aba979f13c53")}, "parent": Null}}, Object {"identity": Object {"description": String(""), "id": String("421b8a93-e2b9-43df-aa9a-1d075e1831e7"), "name": String("proj-666b25e00f1"), "time_created": String("2024-12-21T07:47:30.302448Z"), "time_deleted": Null, "time_modified": String("2024-12-21T07:47:30.302448Z")}, "rcgen": Number(1), "silo_id": String("fe5ecf26-3a15-476c-b566-aba979f13c53")}]) node_id = 0 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
25122024-12-21T07:47:30.327ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
25132024-12-21T07:47:30.327ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
25142024-12-21T07:47:30.338ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
25152024-12-21T07:47:30.338ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"authz_project": Object {"key": String("421b8a93-e2b9-43df-aa9a-1d075e1831e7"), "lookup_type": Object {"ByName": String("proj-666b25e00f1")}, "parent": Object {"key": String("fe5ecf26-3a15-476c-b566-aba979f13c53"), "lookup_type": Object {"ById": String("fe5ecf26-3a15-476c-b566-aba979f13c53")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("fe5ecf26-3a15-476c-b566-aba979f13c53"), "silo_user_id": String("1a51fb95-9352-4c8d-9e2d-5b672a14624e")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd1b:a523:1101::/48"), "name": String("default")}}) node_id = 1 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
25162024-12-21T07:47:30.355ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
25172024-12-21T07:47:30.355ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
25182024-12-21T07:47:30.358ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
25192024-12-21T07:47:30.358ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
25202024-12-21T07:47:30.362ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
25212024-12-21T07:47:30.362ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
25222024-12-21T07:47:30.365ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
25232024-12-21T07:47:30.365ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("fe06afb8-89fd-47d8-8c72-6c475bc4a160")) node_id = 3 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
25242024-12-21T07:47:30.369ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
25252024-12-21T07:47:30.369ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
25262024-12-21T07:47:30.372ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
25272024-12-21T07:47:30.372ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("cef8730c-417a-45a0-a05b-21bb22f5a138")) node_id = 4 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
25282024-12-21T07:47:30.376ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
25292024-12-21T07:47:30.376ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
25302024-12-21T07:47:30.380ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
25312024-12-21T07:47:30.380ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("b3cd70bd-c065-40b9-94c5-f593420888ec")) node_id = 5 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
25322024-12-21T07:47:30.384ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
25332024-12-21T07:47:30.384ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
25342024-12-21T07:47:30.387ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
25352024-12-21T07:47:30.387ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("b6d07ab2-76d1-4361-830b-be8a7f26c46a")) node_id = 6 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
25362024-12-21T07:47:30.391ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
25372024-12-21T07:47:30.391ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
25382024-12-21T07:47:30.401ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
25392024-12-21T07:47:30.401ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("115c2141-70a8-485e-a80a-e3de1c9bd13d")) node_id = 7 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
25402024-12-21T07:47:30.405ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
25412024-12-21T07:47:30.405ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
25422024-12-21T07:47:30.411ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
25432024-12-21T07:47:30.411ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("4ed31b02-23f4-40d1-baa7-e5fb95e9cd8f")) node_id = 8 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
25442024-12-21T07:47:30.416ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
25452024-12-21T07:47:30.416ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
25462024-12-21T07:47:30.421ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateVpc
25472024-12-21T07:47:30.421ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateVpc
25482024-12-21T07:47:30.424ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateVpc
25492024-12-21T07:47:30.424ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateVpc
25502024-12-21T07:47:30.426ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateVpc
25512024-12-21T07:47:30.426ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateVpc
25522024-12-21T07:47:30.429ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateVpc
25532024-12-21T07:47:30.429ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateVpc
25542024-12-21T07:47:30.432ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateVpc
25552024-12-21T07:47:30.434ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Project { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 421b8a93-e2b9-43df-aa9a-1d075e1831e7, lookup_type: ByName("proj-666b25e00f1") } result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateVpc
25562024-12-21T07:47:30.434ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateVpc
25572024-12-21T07:47:30.434ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateVpc
25582024-12-21T07:47:30.458ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
25592024-12-21T07:47:30.458ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("fe06afb8-89fd-47d8-8c72-6c475bc4a160"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("421b8a93-e2b9-43df-aa9a-1d075e1831e7"), "lookup_type": Object {"ByName": String("proj-666b25e00f1")}, "parent": Object {"key": String("fe5ecf26-3a15-476c-b566-aba979f13c53"), "lookup_type": Object {"ById": String("fe5ecf26-3a15-476c-b566-aba979f13c53")}, "parent": Null}}}, Object {"dns_name": String("default"), "firewall_gen": Number(1), "identity": Object {"description": String("Default VPC"), "id": String("fe06afb8-89fd-47d8-8c72-6c475bc4a160"), "name": String("default"), "time_created": String("2024-12-21T07:47:30.421573Z"), "time_deleted": Null, "time_modified": String("2024-12-21T07:47:30.421573Z")}, "ipv6_prefix": String("fd1b:a523:1101::/48"), "project_id": String("421b8a93-e2b9-43df-aa9a-1d075e1831e7"), "subnet_gen": Number(1), "system_router_id": String("cef8730c-417a-45a0-a05b-21bb22f5a138"), "vni": Number(2262053)}]) node_id = 9 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
25602024-12-21T07:47:30.467ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
25612024-12-21T07:47:30.467ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
25622024-12-21T07:47:30.475ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateRouter
25632024-12-21T07:47:30.475ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateRouter
25642024-12-21T07:47:30.477ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateRouter
25652024-12-21T07:47:30.478ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateRouter
25662024-12-21T07:47:30.480ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateRouter
25672024-12-21T07:47:30.480ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateRouter
25682024-12-21T07:47:30.482ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateRouter
25692024-12-21T07:47:30.482ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateRouter
25702024-12-21T07:47:30.484ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateRouter
25712024-12-21T07:47:30.487ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 421b8a93-e2b9-43df-aa9a-1d075e1831e7, lookup_type: ByName("proj-666b25e00f1") }, key: fe06afb8-89fd-47d8-8c72-6c475bc4a160, lookup_type: ByName("default") } result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateRouter
25722024-12-21T07:47:30.487ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateRouter
25732024-12-21T07:47:30.487ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateRouter
25742024-12-21T07:47:30.523ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
25752024-12-21T07:47:30.523ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"key": String("cef8730c-417a-45a0-a05b-21bb22f5a138"), "lookup_type": Object {"ById": String("cef8730c-417a-45a0-a05b-21bb22f5a138")}, "parent": Object {"key": String("fe06afb8-89fd-47d8-8c72-6c475bc4a160"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("421b8a93-e2b9-43df-aa9a-1d075e1831e7"), "lookup_type": Object {"ByName": String("proj-666b25e00f1")}, "parent": Object {"key": String("fe5ecf26-3a15-476c-b566-aba979f13c53"), "lookup_type": Object {"ById": String("fe5ecf26-3a15-476c-b566-aba979f13c53")}, "parent": Null}}}}) node_id = 10 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
25762024-12-21T07:47:30.527ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
25772024-12-21T07:47:30.527ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
25782024-12-21T07:47:30.532ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateV4Route
25792024-12-21T07:47:30.532ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateV4Route
25802024-12-21T07:47:30.534ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateV4Route
25812024-12-21T07:47:30.534ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateV4Route
25822024-12-21T07:47:30.536ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateV4Route
25832024-12-21T07:47:30.537ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateV4Route
25842024-12-21T07:47:30.539ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateV4Route
25852024-12-21T07:47:30.539ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateV4Route
25862024-12-21T07:47:30.542ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateV4Route
25872024-12-21T07:47:30.545ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 421b8a93-e2b9-43df-aa9a-1d075e1831e7, lookup_type: ByName("proj-666b25e00f1") }, key: fe06afb8-89fd-47d8-8c72-6c475bc4a160, lookup_type: ByName("default") }, key: cef8730c-417a-45a0-a05b-21bb22f5a138, lookup_type: ById(cef8730c-417a-45a0-a05b-21bb22f5a138) } result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateV4Route
25882024-12-21T07:47:30.545ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateV4Route
25892024-12-21T07:47:30.545ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateV4Route
25902024-12-21T07:47:30.589ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
25912024-12-21T07:47:30.589ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
25922024-12-21T07:47:30.593ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
25932024-12-21T07:47:30.593ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
25942024-12-21T07:47:30.597ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateV6Route
25952024-12-21T07:47:30.597ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateV6Route
25962024-12-21T07:47:30.600ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateV6Route
25972024-12-21T07:47:30.600ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateV6Route
25982024-12-21T07:47:30.602ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateV6Route
25992024-12-21T07:47:30.602ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateV6Route
26002024-12-21T07:47:30.605ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateV6Route
26012024-12-21T07:47:30.605ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateV6Route
26022024-12-21T07:47:30.607ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateV6Route
26032024-12-21T07:47:30.610ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 421b8a93-e2b9-43df-aa9a-1d075e1831e7, lookup_type: ByName("proj-666b25e00f1") }, key: fe06afb8-89fd-47d8-8c72-6c475bc4a160, lookup_type: ByName("default") }, key: cef8730c-417a-45a0-a05b-21bb22f5a138, lookup_type: ById(cef8730c-417a-45a0-a05b-21bb22f5a138) } result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateV6Route
26042024-12-21T07:47:30.610ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateV6Route
26052024-12-21T07:47:30.610ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateV6Route
26062024-12-21T07:47:30.653ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
26072024-12-21T07:47:30.653ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
26082024-12-21T07:47:30.657ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
26092024-12-21T07:47:30.657ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
26102024-12-21T07:47:30.661ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateSubnet
26112024-12-21T07:47:30.661ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateSubnet
26122024-12-21T07:47:30.664ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateSubnet
26132024-12-21T07:47:30.664ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateSubnet
26142024-12-21T07:47:30.669ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateSubnet
26152024-12-21T07:47:30.670ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateSubnet
26162024-12-21T07:47:30.672ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateSubnet
26172024-12-21T07:47:30.673ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateSubnet
26182024-12-21T07:47:30.675ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateSubnet
26192024-12-21T07:47:30.678ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 421b8a93-e2b9-43df-aa9a-1d075e1831e7, lookup_type: ByName("proj-666b25e00f1") }, key: fe06afb8-89fd-47d8-8c72-6c475bc4a160, lookup_type: ByName("default") } result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateSubnet
26202024-12-21T07:47:30.685ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateSubnet
26212024-12-21T07:47:30.685ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateSubnet
26222024-12-21T07:47:30.700ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateSubnet
26232024-12-21T07:47:30.700ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateSubnet
26242024-12-21T07:47:30.704ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
26252024-12-21T07:47:30.704ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("115c2141-70a8-485e-a80a-e3de1c9bd13d"), "lookup_type": Object {"ById": String("115c2141-70a8-485e-a80a-e3de1c9bd13d")}, "parent": Object {"key": String("fe06afb8-89fd-47d8-8c72-6c475bc4a160"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("421b8a93-e2b9-43df-aa9a-1d075e1831e7"), "lookup_type": Object {"ByName": String("proj-666b25e00f1")}, "parent": Object {"key": String("fe5ecf26-3a15-476c-b566-aba979f13c53"), "lookup_type": Object {"ById": String("fe5ecf26-3a15-476c-b566-aba979f13c53")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("115c2141-70a8-485e-a80a-e3de1c9bd13d"), "name": String("default"), "time_created": String("2024-12-21T07:47:30.661278Z"), "time_deleted": Null, "time_modified": String("2024-12-21T07:47:30.661278Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd1b:a523:1101::/64"), "rcgen": Number(1), "vpc_id": String("fe06afb8-89fd-47d8-8c72-6c475bc4a160")}]) node_id = 13 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
26262024-12-21T07:47:30.708ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
26272024-12-21T07:47:30.708ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
26282024-12-21T07:47:30.712ZDEBGnexus: default firewall rules for vpc default rules = [VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: 188c3bcd-3e3c-4090-8cd5-614d0a8b41d7, name: Name(Name("allow-internal-inbound")), description: "allow inbound traffic to all instances within the VPC if originated within the VPC", time_created: 2024-12-21T07:47:30.712694295Z, time_modified: 2024-12-21T07:47:30.712694295Z, time_deleted: None }, vpc_id: fe06afb8-89fd-47d8-8c72-6c475bc4a160, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: Some([VpcFirewallRuleHostFilter(Vpc(Name("default")))]), filter_ports: None, filter_protocols: None, action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }, VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: cdbcf7de-04d6-4fff-9122-9f286471758b, name: Name(Name("allow-ssh")), description: "allow inbound TCP connections on port 22 from anywhere", time_created: 2024-12-21T07:47:30.712697775Z, time_modified: 2024-12-21T07:47:30.712697775Z, time_deleted: None }, vpc_id: fe06afb8-89fd-47d8-8c72-6c475bc4a160, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: None, filter_ports: Some([L4PortRange(L4PortRange { first: L4Port(22), last: L4Port(22) })]), filter_protocols: Some([VpcFirewallRuleProtocol(Tcp)]), action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }, VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: d47e23c8-28ed-4f67-8e8c-7feedde6b8e9, name: Name(Name("allow-icmp")), description: "allow inbound ICMP traffic from anywhere", time_created: 2024-12-21T07:47:30.712698915Z, time_modified: 2024-12-21T07:47:30.712698915Z, time_deleted: None }, vpc_id: fe06afb8-89fd-47d8-8c72-6c475bc4a160, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: None, filter_ports: None, filter_protocols: Some([VpcFirewallRuleProtocol(Icmp)]), action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }]
26292024-12-21T07:47:30.712ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcUpdateFirewall
26302024-12-21T07:47:30.713ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcUpdateFirewall
26312024-12-21T07:47:30.715ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcUpdateFirewall
26322024-12-21T07:47:30.715ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcUpdateFirewall
26332024-12-21T07:47:30.717ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcUpdateFirewall
26342024-12-21T07:47:30.717ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcUpdateFirewall
26352024-12-21T07:47:30.719ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcUpdateFirewall
26362024-12-21T07:47:30.719ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcUpdateFirewall
26372024-12-21T07:47:30.721ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcUpdateFirewall
26382024-12-21T07:47:30.724ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 421b8a93-e2b9-43df-aa9a-1d075e1831e7, lookup_type: ByName("proj-666b25e00f1") }, key: fe06afb8-89fd-47d8-8c72-6c475bc4a160, lookup_type: ByName("default") } result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcUpdateFirewall
26392024-12-21T07:47:30.724ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcUpdateFirewall
26402024-12-21T07:47:30.724ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcUpdateFirewall
26412024-12-21T07:47:30.781ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
26422024-12-21T07:47:30.781ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("188c3bcd-3e3c-4090-8cd5-614d0a8b41d7"), "name": String("allow-internal-inbound"), "time_created": String("2024-12-21T07:47:30.712694295Z"), "time_deleted": Null, "time_modified": String("2024-12-21T07:47:30.712694295Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("fe06afb8-89fd-47d8-8c72-6c475bc4a160")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [String("TCP")], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("cdbcf7de-04d6-4fff-9122-9f286471758b"), "name": String("allow-ssh"), "time_created": String("2024-12-21T07:47:30.712697775Z"), "time_deleted": Null, "time_modified": String("2024-12-21T07:47:30.712697775Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("fe06afb8-89fd-47d8-8c72-6c475bc4a160")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [String("ICMP")], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("d47e23c8-28ed-4f67-8e8c-7feedde6b8e9"), "name": String("allow-icmp"), "time_created": String("2024-12-21T07:47:30.712698915Z"), "time_deleted": Null, "time_modified": String("2024-12-21T07:47:30.712698915Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("fe06afb8-89fd-47d8-8c72-6c475bc4a160")}]) node_id = 14 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
26432024-12-21T07:47:30.785ZDEBGnexus (SEC): saga log event new_state = N015 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
26442024-12-21T07:47:30.785ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 15 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
26452024-12-21T07:47:30.788ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateGateway
26462024-12-21T07:47:30.789ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateGateway
26472024-12-21T07:47:30.790ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateGateway
26482024-12-21T07:47:30.791ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateGateway
26492024-12-21T07:47:30.793ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateGateway
26502024-12-21T07:47:30.793ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateGateway
26512024-12-21T07:47:30.796ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateGateway
26522024-12-21T07:47:30.796ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateGateway
26532024-12-21T07:47:30.798ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateGateway
26542024-12-21T07:47:30.801ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 421b8a93-e2b9-43df-aa9a-1d075e1831e7, lookup_type: ByName("proj-666b25e00f1") }, key: fe06afb8-89fd-47d8-8c72-6c475bc4a160, lookup_type: ByName("default") } result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateGateway
26552024-12-21T07:47:30.801ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateGateway
26562024-12-21T07:47:30.801ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateGateway
26572024-12-21T07:47:30.806ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateGateway
26582024-12-21T07:47:30.806ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateGateway
26592024-12-21T07:47:30.811ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateGateway
26602024-12-21T07:47:30.811ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateGateway
26612024-12-21T07:47:30.815ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateGateway
26622024-12-21T07:47:30.815ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateGateway
26632024-12-21T07:47:30.817ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateGateway
26642024-12-21T07:47:30.817ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateGateway
26652024-12-21T07:47:30.820ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateGateway
26662024-12-21T07:47:30.820ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateGateway
26672024-12-21T07:47:30.822ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateGateway
26682024-12-21T07:47:30.823ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateGateway
26692024-12-21T07:47:30.824ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateGateway
26702024-12-21T07:47:30.827ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 421b8a93-e2b9-43df-aa9a-1d075e1831e7, lookup_type: ByName("proj-666b25e00f1") }, key: fe06afb8-89fd-47d8-8c72-6c475bc4a160, lookup_type: ByName("default") }, key: 4ed31b02-23f4-40d1-baa7-e5fb95e9cd8f, lookup_type: ById(4ed31b02-23f4-40d1-baa7-e5fb95e9cd8f) } result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateGateway
26712024-12-21T07:47:30.827ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateGateway
26722024-12-21T07:47:30.828ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcCreateGateway
26732024-12-21T07:47:30.838ZDEBGnexus (SEC): saga log event new_state = N015 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
26742024-12-21T07:47:30.838ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"key": String("4ed31b02-23f4-40d1-baa7-e5fb95e9cd8f"), "lookup_type": Object {"ById": String("4ed31b02-23f4-40d1-baa7-e5fb95e9cd8f")}, "parent": Object {"key": String("fe06afb8-89fd-47d8-8c72-6c475bc4a160"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("421b8a93-e2b9-43df-aa9a-1d075e1831e7"), "lookup_type": Object {"ByName": String("proj-666b25e00f1")}, "parent": Object {"key": String("fe5ecf26-3a15-476c-b566-aba979f13c53"), "lookup_type": Object {"ById": String("fe5ecf26-3a15-476c-b566-aba979f13c53")}, "parent": Null}}}}) node_id = 15 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
26752024-12-21T07:47:30.843ZDEBGnexus (SEC): saga log event new_state = N016 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
26762024-12-21T07:47:30.843ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 16 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
26772024-12-21T07:47:30.848ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcNotifySleds
26782024-12-21T07:47:30.849ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcNotifySleds
26792024-12-21T07:47:30.851ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcNotifySleds
26802024-12-21T07:47:30.851ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcNotifySleds
26812024-12-21T07:47:30.852ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcNotifySleds
26822024-12-21T07:47:30.852ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcNotifySleds
26832024-12-21T07:47:30.854ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcNotifySleds
26842024-12-21T07:47:30.855ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcNotifySleds
26852024-12-21T07:47:30.857ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcNotifySleds
26862024-12-21T07:47:30.857ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcNotifySleds
26872024-12-21T07:47:30.860ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcNotifySleds
26882024-12-21T07:47:30.860ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcNotifySleds
26892024-12-21T07:47:30.863ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcNotifySleds
26902024-12-21T07:47:30.863ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcNotifySleds
26912024-12-21T07:47:30.865ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcNotifySleds
26922024-12-21T07:47:30.867ZDEBGnexus (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 421b8a93-e2b9-43df-aa9a-1d075e1831e7, lookup_type: ById(421b8a93-e2b9-43df-aa9a-1d075e1831e7) }, key: fe06afb8-89fd-47d8-8c72-6c475bc4a160, lookup_type: ByName("default") } result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcNotifySleds
26932024-12-21T07:47:30.867ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcNotifySleds
26942024-12-21T07:47:30.867ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcNotifySleds
26952024-12-21T07:47:30.870ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcNotifySleds
26962024-12-21T07:47:30.870ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcNotifySleds
26972024-12-21T07:47:30.873ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcNotifySleds
26982024-12-21T07:47:30.873ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcNotifySleds
26992024-12-21T07:47:30.875ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcNotifySleds
27002024-12-21T07:47:30.875ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcNotifySleds
27012024-12-21T07:47:30.878ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcNotifySleds
27022024-12-21T07:47:30.881ZDEBGnexus (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 421b8a93-e2b9-43df-aa9a-1d075e1831e7, lookup_type: ById(421b8a93-e2b9-43df-aa9a-1d075e1831e7) }, key: fe06afb8-89fd-47d8-8c72-6c475bc4a160, lookup_type: ByName("default") } result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcNotifySleds
27032024-12-21T07:47:30.881ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcNotifySleds
27042024-12-21T07:47:30.881ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_node = VpcNotifySleds
27052024-12-21T07:47:30.890ZDEBGnexus: resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {} subnet_networks = {} vpc_interfaces = {}
27062024-12-21T07:47:30.890ZDEBGnexus: resolved firewall rules for sled agents sled_agent_rules = []
27072024-12-21T07:47:30.890ZDEBGnexus: resolved 0 rules for sleds
27082024-12-21T07:47:30.910ZDEBGnexus: resolved sleds for vpc default vpc_to_sled = []
27092024-12-21T07:47:30.910ZDEBGnexus: sending firewall rules to sled agents
27102024-12-21T07:47:30.910ZINFOnexus: updated firewall rules on 0 sleds file = nexus/networking/src/firewall_rules.rs:496
27112024-12-21T07:47:30.910ZDEBGnexus (SEC): saga log event new_state = N016 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
27122024-12-21T07:47:30.910ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 16 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
27132024-12-21T07:47:30.914ZDEBGnexus (SEC): saga log event new_state = N017 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
27142024-12-21T07:47:30.914ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 17 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
27152024-12-21T07:47:30.918ZDEBGnexus (SEC): saga log event new_state = N017 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
27162024-12-21T07:47:30.918ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 17 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
27172024-12-21T07:47:30.920ZDEBGnexus (SEC): saga log event new_state = N019 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
27182024-12-21T07:47:30.920ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 19 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
27192024-12-21T07:47:30.925ZDEBGnexus (SEC): saga log event new_state = N019 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
27202024-12-21T07:47:30.925ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 19 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
27212024-12-21T07:47:30.928ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = f315012a-bc11-4c37-83c5-c2e540283251 sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
27222024-12-21T07:47:30.928ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = f315012a-bc11-4c37-83c5-c2e540283251
27232024-12-21T07:47:30.989ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
27242024-12-21T07:47:30.989ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = f315012a-bc11-4c37-83c5-c2e540283251 saga_name = project-create saga_result = SagaResult { saga_id: f315012a-bc11-4c37-83c5-c2e540283251, saga_log: SagaLog { saga_id: f315012a-bc11-4c37-83c5-c2e540283251, unwinding: false, events: [N018 started, N018 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N013 started, N013 succeeded, N014 started, N014 succeeded, N015 started, N015 succeeded, N016 started, N016 succeeded, N017 started, N017 succeeded, N019 started, N019 succeeded], node_status: {0: Succeeded(Array [Object {"key": String("421b8a93-e2b9-43df-aa9a-1d075e1831e7"), "lookup_type": Object {"ByName": String("proj-666b25e00f1")}, "parent": Object {"key": String("fe5ecf26-3a15-476c-b566-aba979f13c53"), "lookup_type": Object {"ById": String("fe5ecf26-3a15-476c-b566-aba979f13c53")}, "parent": Null}}, Object {"identity": Object {"description": String(""), "id": String("421b8a93-e2b9-43df-aa9a-1d075e1831e7"), "name": String("proj-666b25e00f1"), "time_created": String("2024-12-21T07:47:30.302448Z"), "time_deleted": Null, "time_modified": String("2024-12-21T07:47:30.302448Z")}, "rcgen": Number(1), "silo_id": String("fe5ecf26-3a15-476c-b566-aba979f13c53")}]), 1: Succeeded(Object {"authz_project": Object {"key": String("421b8a93-e2b9-43df-aa9a-1d075e1831e7"), "lookup_type": Object {"ByName": String("proj-666b25e00f1")}, "parent": Object {"key": String("fe5ecf26-3a15-476c-b566-aba979f13c53"), "lookup_type": Object {"ById": String("fe5ecf26-3a15-476c-b566-aba979f13c53")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("fe5ecf26-3a15-476c-b566-aba979f13c53"), "silo_user_id": String("1a51fb95-9352-4c8d-9e2d-5b672a14624e")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd1b:a523:1101::/48"), "name": String("default")}}), 2: Succeeded(Null), 3: Succeeded(String("fe06afb8-89fd-47d8-8c72-6c475bc4a160")), 4: Succeeded(String("cef8730c-417a-45a0-a05b-21bb22f5a138")), 5: Succeeded(String("b3cd70bd-c065-40b9-94c5-f593420888ec")), 6: Succeeded(String("b6d07ab2-76d1-4361-830b-be8a7f26c46a")), 7: Succeeded(String("115c2141-70a8-485e-a80a-e3de1c9bd13d")), 8: Succeeded(String("4ed31b02-23f4-40d1-baa7-e5fb95e9cd8f")), 9: Succeeded(Array [Object {"key": String("fe06afb8-89fd-47d8-8c72-6c475bc4a160"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("421b8a93-e2b9-43df-aa9a-1d075e1831e7"), "lookup_type": Object {"ByName": String("proj-666b25e00f1")}, "parent": Object {"key": String("fe5ecf26-3a15-476c-b566-aba979f13c53"), "lookup_type": Object {"ById": String("fe5ecf26-3a15-476c-b566-aba979f13c53")}, "parent": Null}}}, Object {"dns_name": String("default"), "firewall_gen": Number(1), "identity": Object {"description": String("Default VPC"), "id": String("fe06afb8-89fd-47d8-8c72-6c475bc4a160"), "name": String("default"), "time_created": String("2024-12-21T07:47:30.421573Z"), "time_deleted": Null, "time_modified": String("2024-12-21T07:47:30.421573Z")}, "ipv6_prefix": String("fd1b:a523:1101::/48"), "project_id": String("421b8a93-e2b9-43df-aa9a-1d075e1831e7"), "subnet_gen": Number(1), "system_router_id": String("cef8730c-417a-45a0-a05b-21bb22f5a138"), "vni": Number(2262053)}]), 10: Succeeded(Object {"key": String("cef8730c-417a-45a0-a05b-21bb22f5a138"), "lookup_type": Object {"ById": String("cef8730c-417a-45a0-a05b-21bb22f5a138")}, "parent": Object {"key": String("fe06afb8-89fd-47d8-8c72-6c475bc4a160"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("421b8a93-e2b9-43df-aa9a-1d075e1831e7"), "lookup_type": Object {"ByName": String("proj-666b25e00f1")}, "parent": Object {"key": String("fe5ecf26-3a15-476c-b566-aba979f13c53"), "lookup_type": Object {"ById": String("fe5ecf26-3a15-476c-b566-aba979f13c53")}, "parent": Null}}}}), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Array [Object {"key": String("115c2141-70a8-485e-a80a-e3de1c9bd13d"), "lookup_type": Object {"ById": String("115c2141-70a8-485e-a80a-e3de1c9bd13d")}, "parent": Object {"key": String("fe06afb8-89fd-47d8-8c72-6c475bc4a160"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("421b8a93-e2b9-43df-aa9a-1d075e1831e7"), "lookup_type": Object {"ByName": String("proj-666b25e00f1")}, "parent": Object {"key": String("fe5ecf26-3a15-476c-b566-aba979f13c53"), "lookup_type": Object {"ById": String("fe5ecf26-3a15-476c-b566-aba979f13c53")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("115c2141-70a8-485e-a80a-e3de1c9bd13d"), "name": String("default"), "time_created": String("2024-12-21T07:47:30.661278Z"), "time_deleted": Null, "time_modified": String("2024-12-21T07:47:30.661278Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd1b:a523:1101::/64"), "rcgen": Number(1), "vpc_id": String("fe06afb8-89fd-47d8-8c72-6c475bc4a160")}]), 14: Succeeded(Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("188c3bcd-3e3c-4090-8cd5-614d0a8b41d7"), "name": String("allow-internal-inbound"), "time_created": String("2024-12-21T07:47:30.712694295Z"), "time_deleted": Null, "time_modified": String("2024-12-21T07:47:30.712694295Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("fe06afb8-89fd-47d8-8c72-6c475bc4a160")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [String("TCP")], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("cdbcf7de-04d6-4fff-9122-9f286471758b"), "name": String("allow-ssh"), "time_created": String("2024-12-21T07:47:30.712697775Z"), "time_deleted": Null, "time_modified": String("2024-12-21T07:47:30.712697775Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("fe06afb8-89fd-47d8-8c72-6c475bc4a160")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [String("ICMP")], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("d47e23c8-28ed-4f67-8e8c-7feedde6b8e9"), "name": String("allow-icmp"), "time_created": String("2024-12-21T07:47:30.712698915Z"), "time_deleted": Null, "time_modified": String("2024-12-21T07:47:30.712698915Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("fe06afb8-89fd-47d8-8c72-6c475bc4a160")}]), 15: Succeeded(Object {"key": String("4ed31b02-23f4-40d1-baa7-e5fb95e9cd8f"), "lookup_type": Object {"ById": String("4ed31b02-23f4-40d1-baa7-e5fb95e9cd8f")}, "parent": Object {"key": String("fe06afb8-89fd-47d8-8c72-6c475bc4a160"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("421b8a93-e2b9-43df-aa9a-1d075e1831e7"), "lookup_type": Object {"ByName": String("proj-666b25e00f1")}, "parent": Object {"key": String("fe5ecf26-3a15-476c-b566-aba979f13c53"), "lookup_type": Object {"ById": String("fe5ecf26-3a15-476c-b566-aba979f13c53")}, "parent": Null}}}}), 16: Succeeded(Null), 17: Succeeded(Null), 18: Succeeded(Null), 19: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"default_internet_gateway_id": String("4ed31b02-23f4-40d1-baa7-e5fb95e9cd8f"), "default_subnet_id": String("115c2141-70a8-485e-a80a-e3de1c9bd13d"), "default_v4_route_id": String("b3cd70bd-c065-40b9-94c5-f593420888ec"), "default_v6_route_id": String("b6d07ab2-76d1-4361-830b-be8a7f26c46a"), "firewall": Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("188c3bcd-3e3c-4090-8cd5-614d0a8b41d7"), "name": String("allow-internal-inbound"), "time_created": String("2024-12-21T07:47:30.712694295Z"), "time_deleted": Null, "time_modified": String("2024-12-21T07:47:30.712694295Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("fe06afb8-89fd-47d8-8c72-6c475bc4a160")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [String("TCP")], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("cdbcf7de-04d6-4fff-9122-9f286471758b"), "name": String("allow-ssh"), "time_created": String("2024-12-21T07:47:30.712697775Z"), "time_deleted": Null, "time_modified": String("2024-12-21T07:47:30.712697775Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("fe06afb8-89fd-47d8-8c72-6c475bc4a160")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [String("ICMP")], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("d47e23c8-28ed-4f67-8e8c-7feedde6b8e9"), "name": String("allow-icmp"), "time_created": String("2024-12-21T07:47:30.712698915Z"), "time_deleted": Null, "time_modified": String("2024-12-21T07:47:30.712698915Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("fe06afb8-89fd-47d8-8c72-6c475bc4a160")}], "gateway": Object {"key": String("4ed31b02-23f4-40d1-baa7-e5fb95e9cd8f"), "lookup_type": Object {"ById": String("4ed31b02-23f4-40d1-baa7-e5fb95e9cd8f")}, "parent": Object {"key": String("fe06afb8-89fd-47d8-8c72-6c475bc4a160"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("421b8a93-e2b9-43df-aa9a-1d075e1831e7"), "lookup_type": Object {"ByName": String("proj-666b25e00f1")}, "parent": Object {"key": String("fe5ecf26-3a15-476c-b566-aba979f13c53"), "lookup_type": Object {"ById": String("fe5ecf26-3a15-476c-b566-aba979f13c53")}, "parent": Null}}}}, "no_result": Null, "project": Array [Object {"key": String("421b8a93-e2b9-43df-aa9a-1d075e1831e7"), "lookup_type": Object {"ByName": String("proj-666b25e00f1")}, "parent": Object {"key": String("fe5ecf26-3a15-476c-b566-aba979f13c53"), "lookup_type": Object {"ById": String("fe5ecf26-3a15-476c-b566-aba979f13c53")}, "parent": Null}}, Object {"identity": Object {"description": String(""), "id": String("421b8a93-e2b9-43df-aa9a-1d075e1831e7"), "name": String("proj-666b25e00f1"), "time_created": String("2024-12-21T07:47:30.302448Z"), "time_deleted": Null, "time_modified": String("2024-12-21T07:47:30.302448Z")}, "rcgen": Number(1), "silo_id": String("fe5ecf26-3a15-476c-b566-aba979f13c53")}], "route4": Null, "route6": Null, "router": Object {"key": String("cef8730c-417a-45a0-a05b-21bb22f5a138"), "lookup_type": Object {"ById": String("cef8730c-417a-45a0-a05b-21bb22f5a138")}, "parent": Object {"key": String("fe06afb8-89fd-47d8-8c72-6c475bc4a160"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("421b8a93-e2b9-43df-aa9a-1d075e1831e7"), "lookup_type": Object {"ByName": String("proj-666b25e00f1")}, "parent": Object {"key": String("fe5ecf26-3a15-476c-b566-aba979f13c53"), "lookup_type": Object {"ById": String("fe5ecf26-3a15-476c-b566-aba979f13c53")}, "parent": Null}}}}, "subnet": Array [Object {"key": String("115c2141-70a8-485e-a80a-e3de1c9bd13d"), "lookup_type": Object {"ById": String("115c2141-70a8-485e-a80a-e3de1c9bd13d")}, "parent": Object {"key": String("fe06afb8-89fd-47d8-8c72-6c475bc4a160"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("421b8a93-e2b9-43df-aa9a-1d075e1831e7"), "lookup_type": Object {"ByName": String("proj-666b25e00f1")}, "parent": Object {"key": String("fe5ecf26-3a15-476c-b566-aba979f13c53"), "lookup_type": Object {"ById": String("fe5ecf26-3a15-476c-b566-aba979f13c53")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("115c2141-70a8-485e-a80a-e3de1c9bd13d"), "name": String("default"), "time_created": String("2024-12-21T07:47:30.661278Z"), "time_deleted": Null, "time_modified": String("2024-12-21T07:47:30.661278Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd1b:a523:1101::/64"), "rcgen": Number(1), "vpc_id": String("fe06afb8-89fd-47d8-8c72-6c475bc4a160")}], "system_router_id": String("cef8730c-417a-45a0-a05b-21bb22f5a138"), "vpc": Null, "vpc_create_params": Object {"authz_project": Object {"key": String("421b8a93-e2b9-43df-aa9a-1d075e1831e7"), "lookup_type": Object {"ByName": String("proj-666b25e00f1")}, "parent": Object {"key": String("fe5ecf26-3a15-476c-b566-aba979f13c53"), "lookup_type": Object {"ById": String("fe5ecf26-3a15-476c-b566-aba979f13c53")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("fe5ecf26-3a15-476c-b566-aba979f13c53"), "silo_user_id": String("1a51fb95-9352-4c8d-9e2d-5b672a14624e")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd1b:a523:1101::/48"), "name": String("default")}}, "vpc_id": String("fe06afb8-89fd-47d8-8c72-6c475bc4a160")} }) }
27252024-12-21T07:47:30.989ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 830961 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = b08becb2-fc05-4adc-9427-e8645af0772a response_code = 201 uri = /v1/projects
27262024-12-21T07:47:30.992ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27272024-12-21T07:47:30.993ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27282024-12-21T07:47:30.994ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27292024-12-21T07:47:30.994ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27302024-12-21T07:47:30.995ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27312024-12-21T07:47:30.997ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9b209be00ecb321a38c92e6ec4fe4002342d4be6", lookup_type: ByCompositeId("token = \\"9b209be00ecb321a38c92e6ec4fe4002342d4be6\\"") } result = Ok(())
27322024-12-21T07:47:30.997ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27332024-12-21T07:47:30.997ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27342024-12-21T07:47:30.998ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27352024-12-21T07:47:30.999ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27362024-12-21T07:47:31.000ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27372024-12-21T07:47:31.000ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27382024-12-21T07:47:31.002ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27392024-12-21T07:47:31.002ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27402024-12-21T07:47:31.003ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27412024-12-21T07:47:31.005ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, lookup_type: ById(1a51fb95-9352-4c8d-9e2d-5b672a14624e) } result = Ok(())
27422024-12-21T07:47:31.005ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27432024-12-21T07:47:31.005ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27442024-12-21T07:47:31.006ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27452024-12-21T07:47:31.007ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9b209be00ecb321a38c92e6ec4fe4002342d4be6", lookup_type: ByCompositeId("9b209be00ecb321a38c92e6ec4fe4002342d4be6") } result = Ok(())
27462024-12-21T07:47:31.007ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27472024-12-21T07:47:31.007ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27482024-12-21T07:47:31.013ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27492024-12-21T07:47:31.013ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27502024-12-21T07:47:31.015ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27512024-12-21T07:47:31.015ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27522024-12-21T07:47:31.016ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27532024-12-21T07:47:31.016ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27542024-12-21T07:47:31.018ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27552024-12-21T07:47:31.018ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27562024-12-21T07:47:31.019ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27572024-12-21T07:47:31.020ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, lookup_type: ById(1a51fb95-9352-4c8d-9e2d-5b672a14624e) } result = Ok(())
27582024-12-21T07:47:31.020ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27592024-12-21T07:47:31.020ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27602024-12-21T07:47:31.022ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27612024-12-21T07:47:31.022ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27622024-12-21T07:47:31.023ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27632024-12-21T07:47:31.023ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27642024-12-21T07:47:31.025ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27652024-12-21T07:47:31.026ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) } result = Ok(())
27662024-12-21T07:47:31.026ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 305eb4ce-a6a0-4be6-af50-55d6f99580a9 roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-666b25e00f1
27672024-12-21T07:47:31.026ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 305eb4ce-a6a0-4be6-af50-55d6f99580a9 resource = Database result = Ok(()) uri = /v1/disks?project=proj-666b25e00f1
27682024-12-21T07:47:31.027ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 305eb4ce-a6a0-4be6-af50-55d6f99580a9 roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-666b25e00f1
27692024-12-21T07:47:31.027ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 305eb4ce-a6a0-4be6-af50-55d6f99580a9 resource = Database result = Ok(()) uri = /v1/disks?project=proj-666b25e00f1
27702024-12-21T07:47:31.029ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 305eb4ce-a6a0-4be6-af50-55d6f99580a9 roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-666b25e00f1
27712024-12-21T07:47:31.029ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 305eb4ce-a6a0-4be6-af50-55d6f99580a9 resource = Database result = Ok(()) uri = /v1/disks?project=proj-666b25e00f1
27722024-12-21T07:47:31.031ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 305eb4ce-a6a0-4be6-af50-55d6f99580a9 roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-666b25e00f1
27732024-12-21T07:47:31.032ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 305eb4ce-a6a0-4be6-af50-55d6f99580a9 resource = Database result = Ok(()) uri = /v1/disks?project=proj-666b25e00f1
27742024-12-21T07:47:31.034ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 305eb4ce-a6a0-4be6-af50-55d6f99580a9 roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-666b25e00f1
27752024-12-21T07:47:31.034ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 305eb4ce-a6a0-4be6-af50-55d6f99580a9 resource = Database result = Ok(()) uri = /v1/disks?project=proj-666b25e00f1
27762024-12-21T07:47:31.037ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 305eb4ce-a6a0-4be6-af50-55d6f99580a9 roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-666b25e00f1
27772024-12-21T07:47:31.037ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 305eb4ce-a6a0-4be6-af50-55d6f99580a9 resource = Database result = Ok(()) uri = /v1/disks?project=proj-666b25e00f1
27782024-12-21T07:47:31.039ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 305eb4ce-a6a0-4be6-af50-55d6f99580a9 roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } uri = /v1/disks?project=proj-666b25e00f1
27792024-12-21T07:47:31.041ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 305eb4ce-a6a0-4be6-af50-55d6f99580a9 resource = Project { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 421b8a93-e2b9-43df-aa9a-1d075e1831e7, lookup_type: ByName("proj-666b25e00f1") } result = Ok(()) uri = /v1/disks?project=proj-666b25e00f1
27802024-12-21T07:47:31.042ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create
27812024-12-21T07:47:31.042ZINFOnexus (SEC): saga create dag = {"end_node":10,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,0,null],[8,10,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateDiskId","name":"disk_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateVolumeId","name":"volume_id"}},{"Action":{"action_name":"disk_create.create_disk_record","label":"CreateDiskRecord","name":"created_disk"}},{"Action":{"action_name":"disk_create.regions_alloc","label":"RegionsAlloc","name":"datasets_and_regions"}},{"Action":{"action_name":"disk_create.space_account","label":"SpaceAccount","name":"no_result"}},{"Action":{"action_name":"disk_create.regions_ensure_undo","label":"RegionsEnsureUndo","name":"regions_ensure_undo"}},{"Action":{"action_name":"disk_create.regions_ensure","label":"RegionsEnsure","name":"regions_ensure"}},{"Action":{"action_name":"disk_create.create_volume_record","label":"CreateVolumeRecord","name":"created_volume"}},{"Action":{"action_name":"disk_create.finalize_disk_record","label":"FinalizeDiskRecord","name":"disk_runtime"}},{"Start":{"params":{"create_params":{"description":"","disk_source":{"block_size":512,"type":"blank"},"name":"disk-99b9da25358","size":1073741824},"project_id":"421b8a93-e2b9-43df-aa9a-1d075e1831e7","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","silo_user_id":"1a51fb95-9352-4c8d-9e2d-5b672a14624e"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"disk-create","start_node":9} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
27822024-12-21T07:47:31.042ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create
27832024-12-21T07:47:31.074ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create
27842024-12-21T07:47:31.074ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
27852024-12-21T07:47:31.074ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
27862024-12-21T07:47:31.074ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5
27872024-12-21T07:47:31.080ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
27882024-12-21T07:47:31.080ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5
27892024-12-21T07:47:31.084ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
27902024-12-21T07:47:31.084ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5
27912024-12-21T07:47:31.089ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
27922024-12-21T07:47:31.089ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("60c70fc2-2177-43bc-b6b6-c92e51e6d2d9")) node_id = 0 saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5
27932024-12-21T07:47:31.095ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
27942024-12-21T07:47:31.095ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5
27952024-12-21T07:47:31.100ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
27962024-12-21T07:47:31.100ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("bbb4eeb2-5c8f-45ed-87b6-58cd1723c78d")) node_id = 1 saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5
27972024-12-21T07:47:31.105ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
27982024-12-21T07:47:31.105ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5
27992024-12-21T07:47:31.110ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = CreateDiskRecord
28002024-12-21T07:47:31.110ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = CreateDiskRecord
28012024-12-21T07:47:31.112ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = CreateDiskRecord
28022024-12-21T07:47:31.112ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = CreateDiskRecord
28032024-12-21T07:47:31.113ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = CreateDiskRecord
28042024-12-21T07:47:31.114ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = CreateDiskRecord
28052024-12-21T07:47:31.116ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = CreateDiskRecord
28062024-12-21T07:47:31.116ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = CreateDiskRecord
28072024-12-21T07:47:31.122ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = CreateDiskRecord
28082024-12-21T07:47:31.122ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = CreateDiskRecord
28092024-12-21T07:47:31.125ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = CreateDiskRecord
28102024-12-21T07:47:31.125ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = CreateDiskRecord
28112024-12-21T07:47:31.128ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = CreateDiskRecord
28122024-12-21T07:47:31.130ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Project { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 421b8a93-e2b9-43df-aa9a-1d075e1831e7, lookup_type: ById(421b8a93-e2b9-43df-aa9a-1d075e1831e7) } result = Ok(()) saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = CreateDiskRecord
28132024-12-21T07:47:31.130ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = CreateDiskRecord
28142024-12-21T07:47:31.130ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = CreateDiskRecord
28152024-12-21T07:47:31.133ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = CreateDiskRecord
28162024-12-21T07:47:31.133ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = CreateDiskRecord
28172024-12-21T07:47:31.134ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = CreateDiskRecord
28182024-12-21T07:47:31.135ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = CreateDiskRecord
28192024-12-21T07:47:31.137ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = CreateDiskRecord
28202024-12-21T07:47:31.137ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = CreateDiskRecord
28212024-12-21T07:47:31.140ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = CreateDiskRecord
28222024-12-21T07:47:31.142ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Project { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 421b8a93-e2b9-43df-aa9a-1d075e1831e7, lookup_type: ById(421b8a93-e2b9-43df-aa9a-1d075e1831e7) } result = Ok(()) saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = CreateDiskRecord
28232024-12-21T07:47:31.142ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = CreateDiskRecord
28242024-12-21T07:47:31.143ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = CreateDiskRecord
28252024-12-21T07:47:31.180ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
28262024-12-21T07:47:31.181ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("60c70fc2-2177-43bc-b6b6-c92e51e6d2d9"), "name": String("disk-99b9da25358"), "time_created": String("2024-12-21T07:47:31.110135Z"), "time_deleted": Null, "time_modified": String("2024-12-21T07:47:31.110135Z")}, "pantry_address": Null, "project_id": String("421b8a93-e2b9-43df-aa9a-1d075e1831e7"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2024-12-21T07:47:31.110135Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("bbb4eeb2-5c8f-45ed-87b6-58cd1723c78d")}) node_id = 2 saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5
28272024-12-21T07:47:31.185ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
28282024-12-21T07:47:31.185ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5
28292024-12-21T07:47:31.188ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = RegionsAlloc
28302024-12-21T07:47:31.188ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = RegionsAlloc
28312024-12-21T07:47:31.249ZINFOnexus (datastore): Allocated regions for volume datasets_and_regions = [(Dataset { identity: DatasetIdentity { id: 0c1b84cb-895b-4282-b52f-4d231ca77fcd (dataset), time_created: 2024-12-21T07:47:23.936580Z, time_modified: 2024-12-21T07:47:23.936580Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: a75efd9d-b0a6-49fa-9887-7bf9c3c748ff, ip: Some(fd00:1122:3344:101::12), port: Some(SqlU16(32345)), kind: Crucible, size_used: Some(1073741824), zone_name: None, quota: None, reservation: None, compression: None }, Region { identity: RegionIdentity { id: 4c0ff9b7-93cd-49d0-85a7-bd014ab3bccc, time_created: 2024-12-21T07:47:31.205112Z, time_modified: 2024-12-21T07:47:31.205112Z }, dataset_id: 0c1b84cb-895b-4282-b52f-4d231ca77fcd (dataset), volume_id: bbb4eeb2-5c8f-45ed-87b6-58cd1723c78d, block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false, deleting: false }), (Dataset { identity: DatasetIdentity { id: 2d40678c-461d-4b0e-b178-c59a8b2ab1d5 (dataset), time_created: 2024-12-21T07:47:23.936580Z, time_modified: 2024-12-21T07:47:23.936580Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: 47117fb2-2ba2-45f6-9fbf-38d2fc290240, ip: Some(fd00:1122:3344:101::14), port: Some(SqlU16(32345)), kind: Crucible, size_used: Some(1073741824), zone_name: None, quota: None, reservation: None, compression: None }, Region { identity: RegionIdentity { id: bbbf3124-0dfb-45d1-bfb4-2742af41197a, time_created: 2024-12-21T07:47:31.205112Z, time_modified: 2024-12-21T07:47:31.205112Z }, dataset_id: 2d40678c-461d-4b0e-b178-c59a8b2ab1d5 (dataset), volume_id: bbb4eeb2-5c8f-45ed-87b6-58cd1723c78d, block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false, deleting: false }), (Dataset { identity: DatasetIdentity { id: 736d079b-8f28-4487-92fb-d85ed3784707 (dataset), time_created: 2024-12-21T07:47:23.936574Z, time_modified: 2024-12-21T07:47:23.936574Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: e8ede2cc-0135-41ed-915f-5a407cd024ac, ip: Some(fd00:1122:3344:101::13), port: Some(SqlU16(32345)), kind: Crucible, size_used: Some(1073741824), zone_name: None, quota: None, reservation: None, compression: None }, Region { identity: RegionIdentity { id: 550ddfaa-f4b5-4bf5-83e1-e9f8c2165634, time_created: 2024-12-21T07:47:31.205112Z, time_modified: 2024-12-21T07:47:31.205112Z }, dataset_id: 736d079b-8f28-4487-92fb-d85ed3784707 (dataset), volume_id: bbb4eeb2-5c8f-45ed-87b6-58cd1723c78d, block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false, deleting: false })] file = nexus/db-queries/src/db/datastore/region.rs:282 maybe_snapshot_id = None volume_id = bbb4eeb2-5c8f-45ed-87b6-58cd1723c78d
28322024-12-21T07:47:31.249ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
28332024-12-21T07:47:31.249ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Array [Object {"compression": Null, "identity": Object {"id": String("0c1b84cb-895b-4282-b52f-4d231ca77fcd"), "time_created": String("2024-12-21T07:47:23.936580Z"), "time_modified": String("2024-12-21T07:47:23.936580Z")}, "ip": String("fd00:1122:3344:101::12"), "kind": String("Crucible"), "pool_id": String("a75efd9d-b0a6-49fa-9887-7bf9c3c748ff"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("0c1b84cb-895b-4282-b52f-4d231ca77fcd"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("4c0ff9b7-93cd-49d0-85a7-bd014ab3bccc"), "time_created": String("2024-12-21T07:47:31.205112Z"), "time_modified": String("2024-12-21T07:47:31.205112Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("bbb4eeb2-5c8f-45ed-87b6-58cd1723c78d")}], Array [Object {"compression": Null, "identity": Object {"id": String("2d40678c-461d-4b0e-b178-c59a8b2ab1d5"), "time_created": String("2024-12-21T07:47:23.936580Z"), "time_modified": String("2024-12-21T07:47:23.936580Z")}, "ip": String("fd00:1122:3344:101::14"), "kind": String("Crucible"), "pool_id": String("47117fb2-2ba2-45f6-9fbf-38d2fc290240"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("2d40678c-461d-4b0e-b178-c59a8b2ab1d5"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("bbbf3124-0dfb-45d1-bfb4-2742af41197a"), "time_created": String("2024-12-21T07:47:31.205112Z"), "time_modified": String("2024-12-21T07:47:31.205112Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("bbb4eeb2-5c8f-45ed-87b6-58cd1723c78d")}], Array [Object {"compression": Null, "identity": Object {"id": String("736d079b-8f28-4487-92fb-d85ed3784707"), "time_created": String("2024-12-21T07:47:23.936574Z"), "time_modified": String("2024-12-21T07:47:23.936574Z")}, "ip": String("fd00:1122:3344:101::13"), "kind": String("Crucible"), "pool_id": String("e8ede2cc-0135-41ed-915f-5a407cd024ac"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("736d079b-8f28-4487-92fb-d85ed3784707"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("550ddfaa-f4b5-4bf5-83e1-e9f8c2165634"), "time_created": String("2024-12-21T07:47:31.205112Z"), "time_modified": String("2024-12-21T07:47:31.205112Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("bbb4eeb2-5c8f-45ed-87b6-58cd1723c78d")}]]) node_id = 3 saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5
28342024-12-21T07:47:31.255ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
28352024-12-21T07:47:31.255ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5
28362024-12-21T07:47:31.259ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = SpaceAccount
28372024-12-21T07:47:31.260ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = SpaceAccount
28382024-12-21T07:47:31.276ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
28392024-12-21T07:47:31.276ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5
28402024-12-21T07:47:31.279ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
28412024-12-21T07:47:31.279ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5
28422024-12-21T07:47:31.283ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
28432024-12-21T07:47:31.283ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5
28442024-12-21T07:47:31.287ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
28452024-12-21T07:47:31.287ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5
28462024-12-21T07:47:31.304ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 136.588471ms dataset = 736d079b-8f28-4487-92fb-d85ed3784707 file = nexus/src/app/crucible.rs:231 region = 550ddfaa-f4b5-4bf5-83e1-e9f8c2165634 saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create
28472024-12-21T07:47:31.306ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 195.264303ms dataset = 2d40678c-461d-4b0e-b178-c59a8b2ab1d5 file = nexus/src/app/crucible.rs:231 region = bbbf3124-0dfb-45d1-bfb4-2742af41197a saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create
28482024-12-21T07:47:31.314ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 360.583211ms dataset = 0c1b84cb-895b-4282-b52f-4d231ca77fcd file = nexus/src/app/crucible.rs:231 region = 4c0ff9b7-93cd-49d0-85a7-bd014ab3bccc saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create
28492024-12-21T07:47:31.448ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 287.979405ms dataset = 736d079b-8f28-4487-92fb-d85ed3784707 file = nexus/src/app/crucible.rs:231 region = 550ddfaa-f4b5-4bf5-83e1-e9f8c2165634 saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create
28502024-12-21T07:47:31.509ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 428.169652ms dataset = 2d40678c-461d-4b0e-b178-c59a8b2ab1d5 file = nexus/src/app/crucible.rs:231 region = bbbf3124-0dfb-45d1-bfb4-2742af41197a saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create
28512024-12-21T07:47:31.955ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
28522024-12-21T07:47:31.955ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("{\\"type\\":\\"volume\\",\\"id\\":\\"60c70fc2-2177-43bc-b6b6-c92e51e6d2d9\\",\\"block_size\\":512,\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":16,\\"opts\\":{\\"id\\":\\"60c70fc2-2177-43bc-b6b6-c92e51e6d2d9\\",\\"target\\":[\\"[fd00:1122:3344:101::12]:19000\\",\\"[fd00:1122:3344:101::13]:19000\\",\\"[fd00:1122:3344:101::14]:19000\\"],\\"lossy\\":false,\\"flush_timeout\\":null,\\"key\\":\\"/nPsKydkmRcxHljRTiuDxwFCjGD52dqJKMOyzvqKR10=\\",\\"cert_pem\\":null,\\"key_pem\\":null,\\"root_cert_pem\\":null,\\"control\\":null,\\"read_only\\":false},\\"gen\\":1}],\\"read_only_parent\\":null}")) node_id = 6 saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5
28532024-12-21T07:47:31.960ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
28542024-12-21T07:47:31.960ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5
28552024-12-21T07:47:31.984ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
28562024-12-21T07:47:31.984ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 7 saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5
28572024-12-21T07:47:31.989ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
28582024-12-21T07:47:31.989ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5
28592024-12-21T07:47:31.995ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = FinalizeDiskRecord
28602024-12-21T07:47:31.995ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = FinalizeDiskRecord
28612024-12-21T07:47:31.998ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = FinalizeDiskRecord
28622024-12-21T07:47:31.998ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = FinalizeDiskRecord
28632024-12-21T07:47:32.000ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = FinalizeDiskRecord
28642024-12-21T07:47:32.000ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = FinalizeDiskRecord
28652024-12-21T07:47:32.002ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = FinalizeDiskRecord
28662024-12-21T07:47:32.002ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = FinalizeDiskRecord
28672024-12-21T07:47:32.005ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = FinalizeDiskRecord
28682024-12-21T07:47:32.005ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = FinalizeDiskRecord
28692024-12-21T07:47:32.008ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = FinalizeDiskRecord
28702024-12-21T07:47:32.008ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = FinalizeDiskRecord
28712024-12-21T07:47:32.010ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = FinalizeDiskRecord
28722024-12-21T07:47:32.010ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = FinalizeDiskRecord
28732024-12-21T07:47:32.013ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = FinalizeDiskRecord
28742024-12-21T07:47:32.015ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 421b8a93-e2b9-43df-aa9a-1d075e1831e7, lookup_type: ById(421b8a93-e2b9-43df-aa9a-1d075e1831e7) }, key: 60c70fc2-2177-43bc-b6b6-c92e51e6d2d9, lookup_type: ById(60c70fc2-2177-43bc-b6b6-c92e51e6d2d9) } result = Ok(()) saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = FinalizeDiskRecord
28752024-12-21T07:47:32.015ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = FinalizeDiskRecord
28762024-12-21T07:47:32.015ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = FinalizeDiskRecord
28772024-12-21T07:47:32.018ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = FinalizeDiskRecord
28782024-12-21T07:47:32.018ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = FinalizeDiskRecord
28792024-12-21T07:47:32.020ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = FinalizeDiskRecord
28802024-12-21T07:47:32.021ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = FinalizeDiskRecord
28812024-12-21T07:47:32.023ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = FinalizeDiskRecord
28822024-12-21T07:47:32.023ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = FinalizeDiskRecord
28832024-12-21T07:47:32.025ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = FinalizeDiskRecord
28842024-12-21T07:47:32.027ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 421b8a93-e2b9-43df-aa9a-1d075e1831e7, lookup_type: ById(421b8a93-e2b9-43df-aa9a-1d075e1831e7) }, key: 60c70fc2-2177-43bc-b6b6-c92e51e6d2d9, lookup_type: ById(60c70fc2-2177-43bc-b6b6-c92e51e6d2d9) } result = Ok(()) saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = FinalizeDiskRecord
28852024-12-21T07:47:32.027ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = FinalizeDiskRecord
28862024-12-21T07:47:32.028ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_node = FinalizeDiskRecord
28872024-12-21T07:47:32.045ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
28882024-12-21T07:47:32.045ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5
28892024-12-21T07:47:32.053ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
28902024-12-21T07:47:32.053ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5
28912024-12-21T07:47:32.059ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
28922024-12-21T07:47:32.059ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5
28932024-12-21T07:47:32.064ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
28942024-12-21T07:47:32.064ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5
28952024-12-21T07:47:32.079ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
28962024-12-21T07:47:32.080ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5 saga_name = disk-create saga_result = SagaResult { saga_id: 28ef99c9-5b09-4290-b272-ae68fcf381f5, saga_log: SagaLog { saga_id: 28ef99c9-5b09-4290-b272-ae68fcf381f5, unwinding: false, events: [N009 started, N009 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N010 started, N010 succeeded], node_status: {0: Succeeded(String("60c70fc2-2177-43bc-b6b6-c92e51e6d2d9")), 1: Succeeded(String("bbb4eeb2-5c8f-45ed-87b6-58cd1723c78d")), 2: Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("60c70fc2-2177-43bc-b6b6-c92e51e6d2d9"), "name": String("disk-99b9da25358"), "time_created": String("2024-12-21T07:47:31.110135Z"), "time_deleted": Null, "time_modified": String("2024-12-21T07:47:31.110135Z")}, "pantry_address": Null, "project_id": String("421b8a93-e2b9-43df-aa9a-1d075e1831e7"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2024-12-21T07:47:31.110135Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("bbb4eeb2-5c8f-45ed-87b6-58cd1723c78d")}), 3: Succeeded(Array [Array [Object {"compression": Null, "identity": Object {"id": String("0c1b84cb-895b-4282-b52f-4d231ca77fcd"), "time_created": String("2024-12-21T07:47:23.936580Z"), "time_modified": String("2024-12-21T07:47:23.936580Z")}, "ip": String("fd00:1122:3344:101::12"), "kind": String("Crucible"), "pool_id": String("a75efd9d-b0a6-49fa-9887-7bf9c3c748ff"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("0c1b84cb-895b-4282-b52f-4d231ca77fcd"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("4c0ff9b7-93cd-49d0-85a7-bd014ab3bccc"), "time_created": String("2024-12-21T07:47:31.205112Z"), "time_modified": String("2024-12-21T07:47:31.205112Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("bbb4eeb2-5c8f-45ed-87b6-58cd1723c78d")}], Array [Object {"compression": Null, "identity": Object {"id": String("2d40678c-461d-4b0e-b178-c59a8b2ab1d5"), "time_created": String("2024-12-21T07:47:23.936580Z"), "time_modified": String("2024-12-21T07:47:23.936580Z")}, "ip": String("fd00:1122:3344:101::14"), "kind": String("Crucible"), "pool_id": String("47117fb2-2ba2-45f6-9fbf-38d2fc290240"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("2d40678c-461d-4b0e-b178-c59a8b2ab1d5"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("bbbf3124-0dfb-45d1-bfb4-2742af41197a"), "time_created": String("2024-12-21T07:47:31.205112Z"), "time_modified": String("2024-12-21T07:47:31.205112Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("bbb4eeb2-5c8f-45ed-87b6-58cd1723c78d")}], Array [Object {"compression": Null, "identity": Object {"id": String("736d079b-8f28-4487-92fb-d85ed3784707"), "time_created": String("2024-12-21T07:47:23.936574Z"), "time_modified": String("2024-12-21T07:47:23.936574Z")}, "ip": String("fd00:1122:3344:101::13"), "kind": String("Crucible"), "pool_id": String("e8ede2cc-0135-41ed-915f-5a407cd024ac"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("736d079b-8f28-4487-92fb-d85ed3784707"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("550ddfaa-f4b5-4bf5-83e1-e9f8c2165634"), "time_created": String("2024-12-21T07:47:31.205112Z"), "time_modified": String("2024-12-21T07:47:31.205112Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("bbb4eeb2-5c8f-45ed-87b6-58cd1723c78d")}]]), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(String("{\\"type\\":\\"volume\\",\\"id\\":\\"60c70fc2-2177-43bc-b6b6-c92e51e6d2d9\\",\\"block_size\\":512,\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":16,\\"opts\\":{\\"id\\":\\"60c70fc2-2177-43bc-b6b6-c92e51e6d2d9\\",\\"target\\":[\\"[fd00:1122:3344:101::12]:19000\\",\\"[fd00:1122:3344:101::13]:19000\\",\\"[fd00:1122:3344:101::14]:19000\\"],\\"lossy\\":false,\\"flush_timeout\\":null,\\"key\\":\\"/nPsKydkmRcxHljRTiuDxwFCjGD52dqJKMOyzvqKR10=\\",\\"cert_pem\\":null,\\"key_pem\\":null,\\"root_cert_pem\\":null,\\"control\\":null,\\"read_only\\":false},\\"gen\\":1}],\\"read_only_parent\\":null}")), 7: Succeeded(Null), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"created_disk": Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("60c70fc2-2177-43bc-b6b6-c92e51e6d2d9"), "name": String("disk-99b9da25358"), "time_created": String("2024-12-21T07:47:31.110135Z"), "time_deleted": Null, "time_modified": String("2024-12-21T07:47:31.110135Z")}, "pantry_address": Null, "project_id": String("421b8a93-e2b9-43df-aa9a-1d075e1831e7"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2024-12-21T07:47:31.110135Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("bbb4eeb2-5c8f-45ed-87b6-58cd1723c78d")}, "created_volume": Null, "datasets_and_regions": Array [Array [Object {"compression": Null, "identity": Object {"id": String("0c1b84cb-895b-4282-b52f-4d231ca77fcd"), "time_created": String("2024-12-21T07:47:23.936580Z"), "time_modified": String("2024-12-21T07:47:23.936580Z")}, "ip": String("fd00:1122:3344:101::12"), "kind": String("Crucible"), "pool_id": String("a75efd9d-b0a6-49fa-9887-7bf9c3c748ff"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("0c1b84cb-895b-4282-b52f-4d231ca77fcd"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("4c0ff9b7-93cd-49d0-85a7-bd014ab3bccc"), "time_created": String("2024-12-21T07:47:31.205112Z"), "time_modified": String("2024-12-21T07:47:31.205112Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("bbb4eeb2-5c8f-45ed-87b6-58cd1723c78d")}], Array [Object {"compression": Null, "identity": Object {"id": String("2d40678c-461d-4b0e-b178-c59a8b2ab1d5"), "time_created": String("2024-12-21T07:47:23.936580Z"), "time_modified": String("2024-12-21T07:47:23.936580Z")}, "ip": String("fd00:1122:3344:101::14"), "kind": String("Crucible"), "pool_id": String("47117fb2-2ba2-45f6-9fbf-38d2fc290240"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("2d40678c-461d-4b0e-b178-c59a8b2ab1d5"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("bbbf3124-0dfb-45d1-bfb4-2742af41197a"), "time_created": String("2024-12-21T07:47:31.205112Z"), "time_modified": String("2024-12-21T07:47:31.205112Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("bbb4eeb2-5c8f-45ed-87b6-58cd1723c78d")}], Array [Object {"compression": Null, "identity": Object {"id": String("736d079b-8f28-4487-92fb-d85ed3784707"), "time_created": String("2024-12-21T07:47:23.936574Z"), "time_modified": String("2024-12-21T07:47:23.936574Z")}, "ip": String("fd00:1122:3344:101::13"), "kind": String("Crucible"), "pool_id": String("e8ede2cc-0135-41ed-915f-5a407cd024ac"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("736d079b-8f28-4487-92fb-d85ed3784707"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("550ddfaa-f4b5-4bf5-83e1-e9f8c2165634"), "time_created": String("2024-12-21T07:47:31.205112Z"), "time_modified": String("2024-12-21T07:47:31.205112Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("bbb4eeb2-5c8f-45ed-87b6-58cd1723c78d")}]], "disk_id": String("60c70fc2-2177-43bc-b6b6-c92e51e6d2d9"), "disk_runtime": Null, "no_result": Null, "regions_ensure": String("{\\"type\\":\\"volume\\",\\"id\\":\\"60c70fc2-2177-43bc-b6b6-c92e51e6d2d9\\",\\"block_size\\":512,\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":16,\\"opts\\":{\\"id\\":\\"60c70fc2-2177-43bc-b6b6-c92e51e6d2d9\\",\\"target\\":[\\"[fd00:1122:3344:101::12]:19000\\",\\"[fd00:1122:3344:101::13]:19000\\",\\"[fd00:1122:3344:101::14]:19000\\"],\\"lossy\\":false,\\"flush_timeout\\":null,\\"key\\":\\"/nPsKydkmRcxHljRTiuDxwFCjGD52dqJKMOyzvqKR10=\\",\\"cert_pem\\":null,\\"key_pem\\":null,\\"root_cert_pem\\":null,\\"control\\":null,\\"read_only\\":false},\\"gen\\":1}],\\"read_only_parent\\":null}"), "regions_ensure_undo": Null, "volume_id": String("bbb4eeb2-5c8f-45ed-87b6-58cd1723c78d")} }) }
28972024-12-21T07:47:32.080ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1088510 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 305eb4ce-a6a0-4be6-af50-55d6f99580a9 response_code = 201 uri = /v1/disks?project=proj-666b25e00f1
28982024-12-21T07:47:32.081ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28992024-12-21T07:47:32.082ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29002024-12-21T07:47:32.083ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29012024-12-21T07:47:32.083ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29022024-12-21T07:47:32.085ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
29032024-12-21T07:47:32.086ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9b209be00ecb321a38c92e6ec4fe4002342d4be6", lookup_type: ByCompositeId("token = \\"9b209be00ecb321a38c92e6ec4fe4002342d4be6\\"") } result = Ok(())
29042024-12-21T07:47:32.086ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29052024-12-21T07:47:32.086ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29062024-12-21T07:47:32.088ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29072024-12-21T07:47:32.088ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29082024-12-21T07:47:32.090ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29092024-12-21T07:47:32.090ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29102024-12-21T07:47:32.091ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29112024-12-21T07:47:32.091ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29122024-12-21T07:47:32.092ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
29132024-12-21T07:47:32.094ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, lookup_type: ById(1a51fb95-9352-4c8d-9e2d-5b672a14624e) } result = Ok(())
29142024-12-21T07:47:32.094ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29152024-12-21T07:47:32.094ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29162024-12-21T07:47:32.095ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
29172024-12-21T07:47:32.096ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9b209be00ecb321a38c92e6ec4fe4002342d4be6", lookup_type: ByCompositeId("9b209be00ecb321a38c92e6ec4fe4002342d4be6") } result = Ok(())
29182024-12-21T07:47:32.096ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29192024-12-21T07:47:32.096ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29202024-12-21T07:47:32.100ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29212024-12-21T07:47:32.100ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29222024-12-21T07:47:32.101ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29232024-12-21T07:47:32.102ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29242024-12-21T07:47:32.103ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29252024-12-21T07:47:32.103ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29262024-12-21T07:47:32.104ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29272024-12-21T07:47:32.105ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29282024-12-21T07:47:32.106ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
29292024-12-21T07:47:32.107ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, lookup_type: ById(1a51fb95-9352-4c8d-9e2d-5b672a14624e) } result = Ok(())
29302024-12-21T07:47:32.107ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29312024-12-21T07:47:32.107ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29322024-12-21T07:47:32.109ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29332024-12-21T07:47:32.109ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29342024-12-21T07:47:32.110ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29352024-12-21T07:47:32.110ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29362024-12-21T07:47:32.111ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
29372024-12-21T07:47:32.112ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) } result = Ok(())
29382024-12-21T07:47:32.113ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 580f120c-2604-4e73-b8c1-f20faa921c1b roles = RoleSet { roles: {} } uri = /v1/disks/disk-99b9da25358?project=proj-666b25e00f1
29392024-12-21T07:47:32.113ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 580f120c-2604-4e73-b8c1-f20faa921c1b resource = Database result = Ok(()) uri = /v1/disks/disk-99b9da25358?project=proj-666b25e00f1
29402024-12-21T07:47:32.114ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 580f120c-2604-4e73-b8c1-f20faa921c1b roles = RoleSet { roles: {} } uri = /v1/disks/disk-99b9da25358?project=proj-666b25e00f1
29412024-12-21T07:47:32.114ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 580f120c-2604-4e73-b8c1-f20faa921c1b resource = Database result = Ok(()) uri = /v1/disks/disk-99b9da25358?project=proj-666b25e00f1
29422024-12-21T07:47:32.116ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 580f120c-2604-4e73-b8c1-f20faa921c1b roles = RoleSet { roles: {} } uri = /v1/disks/disk-99b9da25358?project=proj-666b25e00f1
29432024-12-21T07:47:32.117ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 580f120c-2604-4e73-b8c1-f20faa921c1b resource = Database result = Ok(()) uri = /v1/disks/disk-99b9da25358?project=proj-666b25e00f1
29442024-12-21T07:47:32.118ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 580f120c-2604-4e73-b8c1-f20faa921c1b roles = RoleSet { roles: {} } uri = /v1/disks/disk-99b9da25358?project=proj-666b25e00f1
29452024-12-21T07:47:32.119ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 580f120c-2604-4e73-b8c1-f20faa921c1b resource = Database result = Ok(()) uri = /v1/disks/disk-99b9da25358?project=proj-666b25e00f1
29462024-12-21T07:47:32.121ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 580f120c-2604-4e73-b8c1-f20faa921c1b roles = RoleSet { roles: {} } uri = /v1/disks/disk-99b9da25358?project=proj-666b25e00f1
29472024-12-21T07:47:32.121ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 580f120c-2604-4e73-b8c1-f20faa921c1b resource = Database result = Ok(()) uri = /v1/disks/disk-99b9da25358?project=proj-666b25e00f1
29482024-12-21T07:47:32.123ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 580f120c-2604-4e73-b8c1-f20faa921c1b roles = RoleSet { roles: {} } uri = /v1/disks/disk-99b9da25358?project=proj-666b25e00f1
29492024-12-21T07:47:32.123ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 580f120c-2604-4e73-b8c1-f20faa921c1b resource = Database result = Ok(()) uri = /v1/disks/disk-99b9da25358?project=proj-666b25e00f1
29502024-12-21T07:47:32.125ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 580f120c-2604-4e73-b8c1-f20faa921c1b roles = RoleSet { roles: {} } uri = /v1/disks/disk-99b9da25358?project=proj-666b25e00f1
29512024-12-21T07:47:32.126ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 580f120c-2604-4e73-b8c1-f20faa921c1b resource = Database result = Ok(()) uri = /v1/disks/disk-99b9da25358?project=proj-666b25e00f1
29522024-12-21T07:47:32.128ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 580f120c-2604-4e73-b8c1-f20faa921c1b roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } uri = /v1/disks/disk-99b9da25358?project=proj-666b25e00f1
29532024-12-21T07:47:32.131ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 580f120c-2604-4e73-b8c1-f20faa921c1b resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 421b8a93-e2b9-43df-aa9a-1d075e1831e7, lookup_type: ByName("proj-666b25e00f1") }, key: 60c70fc2-2177-43bc-b6b6-c92e51e6d2d9, lookup_type: ByName("disk-99b9da25358") } result = Ok(()) uri = /v1/disks/disk-99b9da25358?project=proj-666b25e00f1
29542024-12-21T07:47:32.131ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 580f120c-2604-4e73-b8c1-f20faa921c1b roles = RoleSet { roles: {} } uri = /v1/disks/disk-99b9da25358?project=proj-666b25e00f1
29552024-12-21T07:47:32.131ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 580f120c-2604-4e73-b8c1-f20faa921c1b resource = Database result = Ok(()) uri = /v1/disks/disk-99b9da25358?project=proj-666b25e00f1
29562024-12-21T07:47:32.133ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 580f120c-2604-4e73-b8c1-f20faa921c1b roles = RoleSet { roles: {} } uri = /v1/disks/disk-99b9da25358?project=proj-666b25e00f1
29572024-12-21T07:47:32.134ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 580f120c-2604-4e73-b8c1-f20faa921c1b resource = Database result = Ok(()) uri = /v1/disks/disk-99b9da25358?project=proj-666b25e00f1
29582024-12-21T07:47:32.135ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 580f120c-2604-4e73-b8c1-f20faa921c1b roles = RoleSet { roles: {} } uri = /v1/disks/disk-99b9da25358?project=proj-666b25e00f1
29592024-12-21T07:47:32.136ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 580f120c-2604-4e73-b8c1-f20faa921c1b resource = Database result = Ok(()) uri = /v1/disks/disk-99b9da25358?project=proj-666b25e00f1
29602024-12-21T07:47:32.138ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 580f120c-2604-4e73-b8c1-f20faa921c1b roles = RoleSet { roles: {} } uri = /v1/disks/disk-99b9da25358?project=proj-666b25e00f1
29612024-12-21T07:47:32.138ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 580f120c-2604-4e73-b8c1-f20faa921c1b resource = Database result = Ok(()) uri = /v1/disks/disk-99b9da25358?project=proj-666b25e00f1
29622024-12-21T07:47:32.140ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 580f120c-2604-4e73-b8c1-f20faa921c1b roles = RoleSet { roles: {} } uri = /v1/disks/disk-99b9da25358?project=proj-666b25e00f1
29632024-12-21T07:47:32.140ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 580f120c-2604-4e73-b8c1-f20faa921c1b resource = Database result = Ok(()) uri = /v1/disks/disk-99b9da25358?project=proj-666b25e00f1
29642024-12-21T07:47:32.143ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 580f120c-2604-4e73-b8c1-f20faa921c1b roles = RoleSet { roles: {} } uri = /v1/disks/disk-99b9da25358?project=proj-666b25e00f1
29652024-12-21T07:47:32.143ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 580f120c-2604-4e73-b8c1-f20faa921c1b resource = Database result = Ok(()) uri = /v1/disks/disk-99b9da25358?project=proj-666b25e00f1
29662024-12-21T07:47:32.145ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 580f120c-2604-4e73-b8c1-f20faa921c1b roles = RoleSet { roles: {} } uri = /v1/disks/disk-99b9da25358?project=proj-666b25e00f1
29672024-12-21T07:47:32.146ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 580f120c-2604-4e73-b8c1-f20faa921c1b resource = Database result = Ok(()) uri = /v1/disks/disk-99b9da25358?project=proj-666b25e00f1
29682024-12-21T07:47:32.148ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 580f120c-2604-4e73-b8c1-f20faa921c1b roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } uri = /v1/disks/disk-99b9da25358?project=proj-666b25e00f1
29692024-12-21T07:47:32.151ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 580f120c-2604-4e73-b8c1-f20faa921c1b resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 421b8a93-e2b9-43df-aa9a-1d075e1831e7, lookup_type: ById(421b8a93-e2b9-43df-aa9a-1d075e1831e7) }, key: 60c70fc2-2177-43bc-b6b6-c92e51e6d2d9, lookup_type: ById(60c70fc2-2177-43bc-b6b6-c92e51e6d2d9) } result = Ok(()) uri = /v1/disks/disk-99b9da25358?project=proj-666b25e00f1
29702024-12-21T07:47:32.151ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2 saga_name = disk-delete
29712024-12-21T07:47:32.151ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,5,null],[4,6,null],[6,7,null],[5,7,null],[7,8,null],[8,9,null],[9,10,null],[10,11,null],[3,4,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"disk_delete.delete_disk_record","label":"DeleteDiskRecord","name":"deleted_disk"}},{"Action":{"action_name":"disk_delete.space_account","label":"SpaceAccount","name":"no_result1"}},{"Constant":{"name":"params_for_volume_delete_subsaga","value":{"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","silo_user_id":"1a51fb95-9352-4c8d-9e2d-5b672a14624e"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}},"volume_id":"bbb4eeb2-5c8f-45ed-87b6-58cd1723c78d"}}},{"SubsagaStart":{"params_node_name":"params_for_volume_delete_subsaga","saga_name":"volume-delete"}},{"Action":{"action_name":"volume_delete.decrease_crucible_resource_count","label":"DecreaseCrucibleResourceCount","name":"crucible_resources_to_delete"}},{"Action":{"action_name":"volume_delete.delete_crucible_regions","label":"DeleteCrucibleRegions","name":"no_result_1"}},{"Action":{"action_name":"volume_delete.delete_crucible_running_snapshots","label":"DeleteCrucibleRunningSnapshots","name":"no_result_2"}},{"Action":{"action_name":"volume_delete.delete_crucible_snapshots","label":"DeleteCrucibleSnapshots","name":"no_result_3"}},{"Action":{"action_name":"volume_delete.delete_crucible_snapshot_records","label":"DeleteCrucibleSnapshotRecords","name":"no_result_4"}},{"Action":{"action_name":"volume_delete.find_freed_crucible_regions","label":"FindFreedCrucibleRegions","name":"freed_crucible_regions"}},{"Action":{"action_name":"volume_delete.delete_freed_crucible_regions","label":"DeleteFreedCrucibleRegions","name":"no_result_5"}},{"Action":{"action_name":"volume_delete.hard_delete_volume_record","label":"HardDeleteVolumeRecord","name":"volume_hard_deleted"}},{"SubsagaEnd":{"name":"volume_delete_subsaga_no_result"}},{"Start":{"params":{"disk_id":"60c70fc2-2177-43bc-b6b6-c92e51e6d2d9","project_id":"421b8a93-e2b9-43df-aa9a-1d075e1831e7","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","silo_user_id":"1a51fb95-9352-4c8d-9e2d-5b672a14624e"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}},"volume_id":"bbb4eeb2-5c8f-45ed-87b6-58cd1723c78d"}}},"End"]},"saga_name":"disk-delete","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2 saga_name = disk-delete sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
29722024-12-21T07:47:32.151ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2 saga_name = disk-delete
29732024-12-21T07:47:32.155ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2 saga_name = disk-delete
29742024-12-21T07:47:32.155ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2 saga_name = disk-delete sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
29752024-12-21T07:47:32.155ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
29762024-12-21T07:47:32.155ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2
29772024-12-21T07:47:32.160ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
29782024-12-21T07:47:32.160ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2
29792024-12-21T07:47:32.175ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
29802024-12-21T07:47:32.175ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2
29812024-12-21T07:47:32.190ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
29822024-12-21T07:47:32.190ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("60c70fc2-2177-43bc-b6b6-c92e51e6d2d9"), "name": String("disk-99b9da25358"), "time_created": String("2024-12-21T07:47:31.110135Z"), "time_deleted": Null, "time_modified": String("2024-12-21T07:47:31.110135Z")}, "pantry_address": Null, "project_id": String("421b8a93-e2b9-43df-aa9a-1d075e1831e7"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-12-21T07:47:32.015651Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("bbb4eeb2-5c8f-45ed-87b6-58cd1723c78d")}) node_id = 0 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2
29832024-12-21T07:47:32.195ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
29842024-12-21T07:47:32.195ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2
29852024-12-21T07:47:32.199ZDEBGnexus (SagaExecutor): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true roles = RoleSet { roles: {} } saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2 saga_name = disk-delete saga_node = SpaceAccount
29862024-12-21T07:47:32.199ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true resource = Database result = Ok(()) saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2 saga_name = disk-delete saga_node = SpaceAccount
29872024-12-21T07:47:32.223ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
29882024-12-21T07:47:32.223ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 1 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2
29892024-12-21T07:47:32.227ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
29902024-12-21T07:47:32.227ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2
29912024-12-21T07:47:32.230ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
29922024-12-21T07:47:32.230ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("fe5ecf26-3a15-476c-b566-aba979f13c53"), "silo_user_id": String("1a51fb95-9352-4c8d-9e2d-5b672a14624e")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("bbb4eeb2-5c8f-45ed-87b6-58cd1723c78d")}) node_id = 2 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2
29932024-12-21T07:47:32.233ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
29942024-12-21T07:47:32.233ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2
29952024-12-21T07:47:32.237ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
29962024-12-21T07:47:32.237ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2
29972024-12-21T07:47:32.240ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
29982024-12-21T07:47:32.240ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2
29992024-12-21T07:47:32.268ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
30002024-12-21T07:47:32.269ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("4c0ff9b7-93cd-49d0-85a7-bd014ab3bccc"), String("550ddfaa-f4b5-4bf5-83e1-e9f8c2165634"), String("bbbf3124-0dfb-45d1-bfb4-2742af41197a")]}}) node_id = 4 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2
30012024-12-21T07:47:32.271ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
30022024-12-21T07:47:32.271ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2
30032024-12-21T07:47:32.275ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
30042024-12-21T07:47:32.275ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2
30052024-12-21T07:47:32.280ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
30062024-12-21T07:47:32.280ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2
30072024-12-21T07:47:32.312ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 86.886163ms file = nexus/src/app/crucible.rs:828 region_id = bbbf3124-0dfb-45d1-bfb4-2742af41197a saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2 saga_name = disk-delete
30082024-12-21T07:47:32.312ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 144.465313ms file = nexus/src/app/crucible.rs:828 region_id = 4c0ff9b7-93cd-49d0-85a7-bd014ab3bccc saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2 saga_name = disk-delete
30092024-12-21T07:47:32.312ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 52.797791ms file = nexus/src/app/crucible.rs:828 region_id = 550ddfaa-f4b5-4bf5-83e1-e9f8c2165634 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2 saga_name = disk-delete
30102024-12-21T07:47:32.369ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 167.318885ms file = nexus/src/app/crucible.rs:828 region_id = 550ddfaa-f4b5-4bf5-83e1-e9f8c2165634 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2 saga_name = disk-delete
30112024-12-21T07:47:32.403ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 66.077554ms file = nexus/src/app/crucible.rs:828 region_id = bbbf3124-0dfb-45d1-bfb4-2742af41197a saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2 saga_name = disk-delete
30122024-12-21T07:47:32.462ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:813 region_id = 4c0ff9b7-93cd-49d0-85a7-bd014ab3bccc saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2 saga_name = disk-delete
30132024-12-21T07:47:32.473ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:813 region_id = bbbf3124-0dfb-45d1-bfb4-2742af41197a saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2 saga_name = disk-delete
30142024-12-21T07:47:32.541ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:813 region_id = 550ddfaa-f4b5-4bf5-83e1-e9f8c2165634 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2 saga_name = disk-delete
30152024-12-21T07:47:32.568ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
30162024-12-21T07:47:32.568ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2
30172024-12-21T07:47:32.572ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
30182024-12-21T07:47:32.572ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2
30192024-12-21T07:47:32.578ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
30202024-12-21T07:47:32.578ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 7 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2
30212024-12-21T07:47:32.583ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
30222024-12-21T07:47:32.583ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2
30232024-12-21T07:47:32.586ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
30242024-12-21T07:47:32.586ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2
30252024-12-21T07:47:32.590ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
30262024-12-21T07:47:32.590ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2
30272024-12-21T07:47:32.599ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
30282024-12-21T07:47:32.599ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"datasets_and_regions": Array [], "volumes": Array []}) node_id = 9 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2
30292024-12-21T07:47:32.602ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
30302024-12-21T07:47:32.602ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2
30312024-12-21T07:47:32.605ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
30322024-12-21T07:47:32.605ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2
30332024-12-21T07:47:32.609ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
30342024-12-21T07:47:32.609ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2
30352024-12-21T07:47:32.616ZINFOnexus (SagaExecutor): allocated regions for bbb4eeb2-5c8f-45ed-87b6-58cd1723c78d is empty, calling volume_hard_delete file = nexus/src/app/sagas/volume_delete.rs:523 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2 saga_name = disk-delete
30362024-12-21T07:47:32.619ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
30372024-12-21T07:47:32.619ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Bool(true)) node_id = 11 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2
30382024-12-21T07:47:32.625ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
30392024-12-21T07:47:32.625ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2
30402024-12-21T07:47:32.630ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
30412024-12-21T07:47:32.630ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Bool(true)) node_id = 12 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2
30422024-12-21T07:47:32.634ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
30432024-12-21T07:47:32.634ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2
30442024-12-21T07:47:32.638ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
30452024-12-21T07:47:32.638ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2
30462024-12-21T07:47:32.640ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2 sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
30472024-12-21T07:47:32.640ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2
30482024-12-21T07:47:32.686ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2 saga_name = disk-delete sec_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
30492024-12-21T07:47:32.686ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2 saga_name = disk-delete saga_result = SagaResult { saga_id: 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2, saga_log: SagaLog { saga_id: 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N006 started, N006 succeeded, N005 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("60c70fc2-2177-43bc-b6b6-c92e51e6d2d9"), "name": String("disk-99b9da25358"), "time_created": String("2024-12-21T07:47:31.110135Z"), "time_deleted": Null, "time_modified": String("2024-12-21T07:47:31.110135Z")}, "pantry_address": Null, "project_id": String("421b8a93-e2b9-43df-aa9a-1d075e1831e7"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-12-21T07:47:32.015651Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("bbb4eeb2-5c8f-45ed-87b6-58cd1723c78d")}), 1: Succeeded(Null), 2: Succeeded(Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("fe5ecf26-3a15-476c-b566-aba979f13c53"), "silo_user_id": String("1a51fb95-9352-4c8d-9e2d-5b672a14624e")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("bbb4eeb2-5c8f-45ed-87b6-58cd1723c78d")}), 3: Succeeded(Null), 4: Succeeded(Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("4c0ff9b7-93cd-49d0-85a7-bd014ab3bccc"), String("550ddfaa-f4b5-4bf5-83e1-e9f8c2165634"), String("bbbf3124-0dfb-45d1-bfb4-2742af41197a")]}}), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Null), 8: Succeeded(Null), 9: Succeeded(Object {"datasets_and_regions": Array [], "volumes": Array []}), 10: Succeeded(Null), 11: Succeeded(Bool(true)), 12: Succeeded(Bool(true)), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Bool(true), node_outputs: {"crucible_resources_to_delete": Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("4c0ff9b7-93cd-49d0-85a7-bd014ab3bccc"), String("550ddfaa-f4b5-4bf5-83e1-e9f8c2165634"), String("bbbf3124-0dfb-45d1-bfb4-2742af41197a")]}}, "deleted_disk": Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("60c70fc2-2177-43bc-b6b6-c92e51e6d2d9"), "name": String("disk-99b9da25358"), "time_created": String("2024-12-21T07:47:31.110135Z"), "time_deleted": Null, "time_modified": String("2024-12-21T07:47:31.110135Z")}, "pantry_address": Null, "project_id": String("421b8a93-e2b9-43df-aa9a-1d075e1831e7"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-12-21T07:47:32.015651Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("bbb4eeb2-5c8f-45ed-87b6-58cd1723c78d")}, "freed_crucible_regions": Object {"datasets_and_regions": Array [], "volumes": Array []}, "no_result1": Null, "no_result_1": Null, "no_result_2": Null, "no_result_3": Null, "no_result_4": Null, "no_result_5": Null, "params_for_volume_delete_subsaga": Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("fe5ecf26-3a15-476c-b566-aba979f13c53"), "silo_user_id": String("1a51fb95-9352-4c8d-9e2d-5b672a14624e")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("bbb4eeb2-5c8f-45ed-87b6-58cd1723c78d")}, "volume_delete_subsaga_no_result": Bool(true), "volume_hard_deleted": Bool(true)} }) }
30502024-12-21T07:47:32.686ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 605004 local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 580f120c-2604-4e73-b8c1-f20faa921c1b response_code = 204 uri = /v1/disks/disk-99b9da25358?project=proj-666b25e00f1
30512024-12-21T07:47:32.687ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30522024-12-21T07:47:32.688ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30532024-12-21T07:47:32.689ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30542024-12-21T07:47:32.691ZDEBGnexus (ExternalAuthn): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = DeviceAuthRequestList result = Ok(())
30552024-12-21T07:47:32.691ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30562024-12-21T07:47:32.691ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30572024-12-21T07:47:32.696ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8231 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 50dd4e92-f073-431a-a202-74cd3f1c64d8 response_code = 200 uri = /device/auth
30582024-12-21T07:47:32.697ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30592024-12-21T07:47:32.698ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30602024-12-21T07:47:32.699ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30612024-12-21T07:47:32.699ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30622024-12-21T07:47:32.700ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30632024-12-21T07:47:32.701ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9b209be00ecb321a38c92e6ec4fe4002342d4be6", lookup_type: ByCompositeId("token = \\"9b209be00ecb321a38c92e6ec4fe4002342d4be6\\"") } result = Ok(())
30642024-12-21T07:47:32.701ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30652024-12-21T07:47:32.702ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30662024-12-21T07:47:32.703ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30672024-12-21T07:47:32.703ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30682024-12-21T07:47:32.704ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30692024-12-21T07:47:32.705ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30702024-12-21T07:47:32.706ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30712024-12-21T07:47:32.706ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30722024-12-21T07:47:32.708ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30732024-12-21T07:47:32.709ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, lookup_type: ById(1a51fb95-9352-4c8d-9e2d-5b672a14624e) } result = Ok(())
30742024-12-21T07:47:32.709ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30752024-12-21T07:47:32.709ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30762024-12-21T07:47:32.710ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30772024-12-21T07:47:32.712ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9b209be00ecb321a38c92e6ec4fe4002342d4be6", lookup_type: ByCompositeId("9b209be00ecb321a38c92e6ec4fe4002342d4be6") } result = Ok(())
30782024-12-21T07:47:32.712ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30792024-12-21T07:47:32.712ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30802024-12-21T07:47:32.716ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30812024-12-21T07:47:32.717ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30822024-12-21T07:47:32.718ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30832024-12-21T07:47:32.718ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30842024-12-21T07:47:32.719ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30852024-12-21T07:47:32.720ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30862024-12-21T07:47:32.723ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30872024-12-21T07:47:32.723ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30882024-12-21T07:47:32.725ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30892024-12-21T07:47:32.727ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, lookup_type: ById(1a51fb95-9352-4c8d-9e2d-5b672a14624e) } result = Ok(())
30902024-12-21T07:47:32.727ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30912024-12-21T07:47:32.727ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30922024-12-21T07:47:32.728ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30932024-12-21T07:47:32.729ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30942024-12-21T07:47:32.730ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30952024-12-21T07:47:32.730ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30962024-12-21T07:47:32.732ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30972024-12-21T07:47:32.733ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) } result = Ok(())
30982024-12-21T07:47:32.733ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7793ac2e-b0f7-404e-9782-243f3fe1600f roles = RoleSet { roles: {} } uri = /device/confirm
30992024-12-21T07:47:32.733ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7793ac2e-b0f7-404e-9782-243f3fe1600f resource = Database result = Ok(()) uri = /device/confirm
31002024-12-21T07:47:32.744ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7793ac2e-b0f7-404e-9782-243f3fe1600f roles = RoleSet { roles: {} } uri = /device/confirm
31012024-12-21T07:47:32.744ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7793ac2e-b0f7-404e-9782-243f3fe1600f resource = Database result = Ok(()) uri = /device/confirm
31022024-12-21T07:47:32.747ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7793ac2e-b0f7-404e-9782-243f3fe1600f roles = RoleSet { roles: {} } uri = /device/confirm
31032024-12-21T07:47:32.747ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7793ac2e-b0f7-404e-9782-243f3fe1600f resource = Database result = Ok(()) uri = /device/confirm
31042024-12-21T07:47:32.750ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7793ac2e-b0f7-404e-9782-243f3fe1600f roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } uri = /device/confirm
31052024-12-21T07:47:32.751ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7793ac2e-b0f7-404e-9782-243f3fe1600f resource = DeviceAuthRequest { parent: Fleet, key: "JPGT-PBRB", lookup_type: ByCompositeId("user_code = \\"JPGT-PBRB\\"") } result = Ok(()) uri = /device/confirm
31062024-12-21T07:47:32.751ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7793ac2e-b0f7-404e-9782-243f3fe1600f roles = RoleSet { roles: {} } uri = /device/confirm
31072024-12-21T07:47:32.752ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7793ac2e-b0f7-404e-9782-243f3fe1600f resource = Database result = Ok(()) uri = /device/confirm
31082024-12-21T07:47:32.753ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7793ac2e-b0f7-404e-9782-243f3fe1600f roles = RoleSet { roles: {} } uri = /device/confirm
31092024-12-21T07:47:32.753ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7793ac2e-b0f7-404e-9782-243f3fe1600f resource = Database result = Ok(()) uri = /device/confirm
31102024-12-21T07:47:32.755ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7793ac2e-b0f7-404e-9782-243f3fe1600f roles = RoleSet { roles: {} } uri = /device/confirm
31112024-12-21T07:47:32.755ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7793ac2e-b0f7-404e-9782-243f3fe1600f resource = Database result = Ok(()) uri = /device/confirm
31122024-12-21T07:47:32.758ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7793ac2e-b0f7-404e-9782-243f3fe1600f roles = RoleSet { roles: {} } uri = /device/confirm
31132024-12-21T07:47:32.758ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7793ac2e-b0f7-404e-9782-243f3fe1600f resource = Database result = Ok(()) uri = /device/confirm
31142024-12-21T07:47:32.760ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7793ac2e-b0f7-404e-9782-243f3fe1600f roles = RoleSet { roles: {} } uri = /device/confirm
31152024-12-21T07:47:32.760ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7793ac2e-b0f7-404e-9782-243f3fe1600f resource = Database result = Ok(()) uri = /device/confirm
31162024-12-21T07:47:32.762ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7793ac2e-b0f7-404e-9782-243f3fe1600f roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } uri = /device/confirm
31172024-12-21T07:47:32.763ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7793ac2e-b0f7-404e-9782-243f3fe1600f resource = SiloUser { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, lookup_type: ById(1a51fb95-9352-4c8d-9e2d-5b672a14624e) } result = Ok(()) uri = /device/confirm
31182024-12-21T07:47:32.763ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7793ac2e-b0f7-404e-9782-243f3fe1600f roles = RoleSet { roles: {} } uri = /device/confirm
31192024-12-21T07:47:32.764ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7793ac2e-b0f7-404e-9782-243f3fe1600f resource = Database result = Ok(()) uri = /device/confirm
31202024-12-21T07:47:32.766ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7793ac2e-b0f7-404e-9782-243f3fe1600f roles = RoleSet { roles: {} } uri = /device/confirm
31212024-12-21T07:47:32.767ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7793ac2e-b0f7-404e-9782-243f3fe1600f resource = Database result = Ok(()) uri = /device/confirm
31222024-12-21T07:47:32.770ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7793ac2e-b0f7-404e-9782-243f3fe1600f roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } uri = /device/confirm
31232024-12-21T07:47:32.770ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7793ac2e-b0f7-404e-9782-243f3fe1600f resource = DeviceAuthRequest { parent: Fleet, key: "JPGT-PBRB", lookup_type: ByCompositeId("user_code = \\"JPGT-PBRB\\"") } result = Ok(()) uri = /device/confirm
31242024-12-21T07:47:32.771ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7793ac2e-b0f7-404e-9782-243f3fe1600f roles = RoleSet { roles: {} } uri = /device/confirm
31252024-12-21T07:47:32.771ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7793ac2e-b0f7-404e-9782-243f3fe1600f resource = Database result = Ok(()) uri = /device/confirm
31262024-12-21T07:47:32.773ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7793ac2e-b0f7-404e-9782-243f3fe1600f roles = RoleSet { roles: {} } uri = /device/confirm
31272024-12-21T07:47:32.773ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7793ac2e-b0f7-404e-9782-243f3fe1600f resource = Database result = Ok(()) uri = /device/confirm
31282024-12-21T07:47:32.775ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7793ac2e-b0f7-404e-9782-243f3fe1600f roles = RoleSet { roles: {} } uri = /device/confirm
31292024-12-21T07:47:32.775ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7793ac2e-b0f7-404e-9782-243f3fe1600f resource = Database result = Ok(()) uri = /device/confirm
31302024-12-21T07:47:32.777ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7793ac2e-b0f7-404e-9782-243f3fe1600f roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } uri = /device/confirm
31312024-12-21T07:47:32.778ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7793ac2e-b0f7-404e-9782-243f3fe1600f resource = SiloUser { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, lookup_type: ById(1a51fb95-9352-4c8d-9e2d-5b672a14624e) } result = Ok(()) uri = /device/confirm
31322024-12-21T07:47:32.778ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7793ac2e-b0f7-404e-9782-243f3fe1600f roles = RoleSet { roles: {} } uri = /device/confirm
31332024-12-21T07:47:32.778ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7793ac2e-b0f7-404e-9782-243f3fe1600f resource = Database result = Ok(()) uri = /device/confirm
31342024-12-21T07:47:32.806ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109180 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 7793ac2e-b0f7-404e-9782-243f3fe1600f response_code = 204 uri = /device/confirm
31352024-12-21T07:47:32.807ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31362024-12-21T07:47:32.807ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31372024-12-21T07:47:32.817ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10125 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56045 req_id = 803e0905-f8e0-4fbb-baad-295dca6a05ad response_code = 200 uri = /device/token
31382024-12-21T07:47:32.819ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31392024-12-21T07:47:32.820ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31402024-12-21T07:47:32.821ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31412024-12-21T07:47:32.821ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31422024-12-21T07:47:32.822ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31432024-12-21T07:47:32.823ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9b209be00ecb321a38c92e6ec4fe4002342d4be6", lookup_type: ByCompositeId("token = \\"9b209be00ecb321a38c92e6ec4fe4002342d4be6\\"") } result = Ok(())
31442024-12-21T07:47:32.823ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31452024-12-21T07:47:32.824ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31462024-12-21T07:47:32.825ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31472024-12-21T07:47:32.825ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31482024-12-21T07:47:32.827ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31492024-12-21T07:47:32.827ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31502024-12-21T07:47:32.828ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31512024-12-21T07:47:32.829ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31522024-12-21T07:47:32.830ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31532024-12-21T07:47:32.831ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, lookup_type: ById(1a51fb95-9352-4c8d-9e2d-5b672a14624e) } result = Ok(())
31542024-12-21T07:47:32.831ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31552024-12-21T07:47:32.832ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31562024-12-21T07:47:32.833ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31572024-12-21T07:47:32.834ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9b209be00ecb321a38c92e6ec4fe4002342d4be6", lookup_type: ByCompositeId("9b209be00ecb321a38c92e6ec4fe4002342d4be6") } result = Ok(())
31582024-12-21T07:47:32.834ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31592024-12-21T07:47:32.834ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31602024-12-21T07:47:32.840ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31612024-12-21T07:47:32.840ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31622024-12-21T07:47:32.841ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31632024-12-21T07:47:32.841ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31642024-12-21T07:47:32.843ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31652024-12-21T07:47:32.843ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31662024-12-21T07:47:32.844ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31672024-12-21T07:47:32.845ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31682024-12-21T07:47:32.846ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31692024-12-21T07:47:32.847ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, lookup_type: ById(1a51fb95-9352-4c8d-9e2d-5b672a14624e) } result = Ok(())
31702024-12-21T07:47:32.847ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31712024-12-21T07:47:32.847ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31722024-12-21T07:47:32.848ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31732024-12-21T07:47:32.849ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31742024-12-21T07:47:32.850ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31752024-12-21T07:47:32.850ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31762024-12-21T07:47:32.852ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31772024-12-21T07:47:32.853ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) } result = Ok(())
31782024-12-21T07:47:32.853ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 8eb73b9e-45d1-4434-9a15-99045887d200 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-666b25e00f1&vpc=default
31792024-12-21T07:47:32.853ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 8eb73b9e-45d1-4434-9a15-99045887d200 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-666b25e00f1&vpc=default
31802024-12-21T07:47:32.855ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 8eb73b9e-45d1-4434-9a15-99045887d200 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-666b25e00f1&vpc=default
31812024-12-21T07:47:32.855ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 8eb73b9e-45d1-4434-9a15-99045887d200 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-666b25e00f1&vpc=default
31822024-12-21T07:47:32.856ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 8eb73b9e-45d1-4434-9a15-99045887d200 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-666b25e00f1&vpc=default
31832024-12-21T07:47:32.856ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 8eb73b9e-45d1-4434-9a15-99045887d200 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-666b25e00f1&vpc=default
31842024-12-21T07:47:32.860ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 8eb73b9e-45d1-4434-9a15-99045887d200 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-666b25e00f1&vpc=default
31852024-12-21T07:47:32.861ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 8eb73b9e-45d1-4434-9a15-99045887d200 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-666b25e00f1&vpc=default
31862024-12-21T07:47:32.863ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 8eb73b9e-45d1-4434-9a15-99045887d200 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-666b25e00f1&vpc=default
31872024-12-21T07:47:32.863ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 8eb73b9e-45d1-4434-9a15-99045887d200 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-666b25e00f1&vpc=default
31882024-12-21T07:47:32.866ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 8eb73b9e-45d1-4434-9a15-99045887d200 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-666b25e00f1&vpc=default
31892024-12-21T07:47:32.866ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 8eb73b9e-45d1-4434-9a15-99045887d200 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-666b25e00f1&vpc=default
31902024-12-21T07:47:32.868ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 8eb73b9e-45d1-4434-9a15-99045887d200 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-666b25e00f1&vpc=default
31912024-12-21T07:47:32.869ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 8eb73b9e-45d1-4434-9a15-99045887d200 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-666b25e00f1&vpc=default
31922024-12-21T07:47:32.871ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 8eb73b9e-45d1-4434-9a15-99045887d200 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-666b25e00f1&vpc=default
31932024-12-21T07:47:32.871ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 8eb73b9e-45d1-4434-9a15-99045887d200 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-666b25e00f1&vpc=default
31942024-12-21T07:47:32.874ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 8eb73b9e-45d1-4434-9a15-99045887d200 roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } uri = /v1/vpc-subnets/default?project=proj-666b25e00f1&vpc=default
31952024-12-21T07:47:32.877ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 8eb73b9e-45d1-4434-9a15-99045887d200 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 421b8a93-e2b9-43df-aa9a-1d075e1831e7, lookup_type: ByName("proj-666b25e00f1") }, key: fe06afb8-89fd-47d8-8c72-6c475bc4a160, lookup_type: ByName("default") }, key: 115c2141-70a8-485e-a80a-e3de1c9bd13d, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-666b25e00f1&vpc=default
31962024-12-21T07:47:32.877ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 8eb73b9e-45d1-4434-9a15-99045887d200 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-666b25e00f1&vpc=default
31972024-12-21T07:47:32.877ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 8eb73b9e-45d1-4434-9a15-99045887d200 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-666b25e00f1&vpc=default
31982024-12-21T07:47:32.880ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 8eb73b9e-45d1-4434-9a15-99045887d200 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-666b25e00f1&vpc=default
31992024-12-21T07:47:32.880ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 8eb73b9e-45d1-4434-9a15-99045887d200 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-666b25e00f1&vpc=default
32002024-12-21T07:47:32.883ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 8eb73b9e-45d1-4434-9a15-99045887d200 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-666b25e00f1&vpc=default
32012024-12-21T07:47:32.883ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 8eb73b9e-45d1-4434-9a15-99045887d200 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-666b25e00f1&vpc=default
32022024-12-21T07:47:32.886ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 8eb73b9e-45d1-4434-9a15-99045887d200 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-666b25e00f1&vpc=default
32032024-12-21T07:47:32.886ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 8eb73b9e-45d1-4434-9a15-99045887d200 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-666b25e00f1&vpc=default
32042024-12-21T07:47:32.888ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 8eb73b9e-45d1-4434-9a15-99045887d200 roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } uri = /v1/vpc-subnets/default?project=proj-666b25e00f1&vpc=default
32052024-12-21T07:47:32.891ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 8eb73b9e-45d1-4434-9a15-99045887d200 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 421b8a93-e2b9-43df-aa9a-1d075e1831e7, lookup_type: ByName("proj-666b25e00f1") }, key: fe06afb8-89fd-47d8-8c72-6c475bc4a160, lookup_type: ByName("default") }, key: 115c2141-70a8-485e-a80a-e3de1c9bd13d, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-666b25e00f1&vpc=default
32062024-12-21T07:47:32.891ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 8eb73b9e-45d1-4434-9a15-99045887d200 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-666b25e00f1&vpc=default
32072024-12-21T07:47:32.891ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 8eb73b9e-45d1-4434-9a15-99045887d200 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-666b25e00f1&vpc=default
32082024-12-21T07:47:32.893ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 8eb73b9e-45d1-4434-9a15-99045887d200 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-666b25e00f1&vpc=default
32092024-12-21T07:47:32.894ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 8eb73b9e-45d1-4434-9a15-99045887d200 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-666b25e00f1&vpc=default
32102024-12-21T07:47:32.900ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 8eb73b9e-45d1-4434-9a15-99045887d200 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-666b25e00f1&vpc=default
32112024-12-21T07:47:32.900ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 8eb73b9e-45d1-4434-9a15-99045887d200 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-666b25e00f1&vpc=default
32122024-12-21T07:47:32.949ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 8eb73b9e-45d1-4434-9a15-99045887d200 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-666b25e00f1&vpc=default
32132024-12-21T07:47:32.950ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 8eb73b9e-45d1-4434-9a15-99045887d200 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-666b25e00f1&vpc=default
32142024-12-21T07:47:32.956ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136620 local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 8eb73b9e-45d1-4434-9a15-99045887d200 response_code = 204 uri = /v1/vpc-subnets/default?project=proj-666b25e00f1&vpc=default
32152024-12-21T07:47:32.956ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 2 reason = Signaled
32162024-12-21T07:47:32.956ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
32172024-12-21T07:47:32.956ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32182024-12-21T07:47:32.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32192024-12-21T07:47:32.957ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32202024-12-21T07:47:32.957ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32212024-12-21T07:47:32.958ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32222024-12-21T07:47:32.959ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32232024-12-21T07:47:32.959ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32242024-12-21T07:47:32.959ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32252024-12-21T07:47:32.959ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32262024-12-21T07:47:32.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32272024-12-21T07:47:32.961ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32282024-12-21T07:47:32.961ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32292024-12-21T07:47:32.962ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9b209be00ecb321a38c92e6ec4fe4002342d4be6", lookup_type: ByCompositeId("token = \\"9b209be00ecb321a38c92e6ec4fe4002342d4be6\\"") } result = Ok(())
32302024-12-21T07:47:32.962ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32312024-12-21T07:47:32.962ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32322024-12-21T07:47:32.963ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32332024-12-21T07:47:32.963ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32342024-12-21T07:47:32.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32352024-12-21T07:47:32.964ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32362024-12-21T07:47:32.964ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32372024-12-21T07:47:32.965ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32382024-12-21T07:47:32.966ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32392024-12-21T07:47:32.967ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32402024-12-21T07:47:32.967ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32412024-12-21T07:47:32.968ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32422024-12-21T07:47:32.970ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, lookup_type: ById(1a51fb95-9352-4c8d-9e2d-5b672a14624e) } result = Ok(())
32432024-12-21T07:47:32.970ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32442024-12-21T07:47:32.970ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32452024-12-21T07:47:32.971ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32462024-12-21T07:47:32.972ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9b209be00ecb321a38c92e6ec4fe4002342d4be6", lookup_type: ByCompositeId("9b209be00ecb321a38c92e6ec4fe4002342d4be6") } result = Ok(())
32472024-12-21T07:47:32.972ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32482024-12-21T07:47:32.973ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32492024-12-21T07:47:32.999ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
32502024-12-21T07:47:32.999ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32512024-12-21T07:47:32.999ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf450083-e856-40cd-b98e-2ed34dd07575", "content-length": "372", "date": "Sat, 21 Dec 2024 07:47:32 GMT"} })
32522024-12-21T07:47:32.999ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32532024-12-21T07:47:32.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32542024-12-21T07:47:33.017ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32552024-12-21T07:47:33.017ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32562024-12-21T07:47:33.019ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32572024-12-21T07:47:33.019ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32582024-12-21T07:47:33.021ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32592024-12-21T07:47:33.021ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32602024-12-21T07:47:33.021ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
32612024-12-21T07:47:33.021ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
32622024-12-21T07:47:33.022ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c1e28aea-7666-419c-a66a-7fef5e034c44", "date": "Sat, 21 Dec 2024 07:47:32 GMT"} })
32632024-12-21T07:47:33.022ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32642024-12-21T07:47:33.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32652024-12-21T07:47:33.023ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32662024-12-21T07:47:33.023ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32672024-12-21T07:47:33.024ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32682024-12-21T07:47:33.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32692024-12-21T07:47:33.024ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32702024-12-21T07:47:33.025ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, lookup_type: ById(1a51fb95-9352-4c8d-9e2d-5b672a14624e) } result = Ok(())
32712024-12-21T07:47:33.025ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32722024-12-21T07:47:33.026ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32732024-12-21T07:47:33.027ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32742024-12-21T07:47:33.028ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32752024-12-21T07:47:33.028ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32762024-12-21T07:47:33.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32772024-12-21T07:47:33.029ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32782024-12-21T07:47:33.029ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32792024-12-21T07:47:33.030ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
32802024-12-21T07:47:33.030ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32812024-12-21T07:47:33.030ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32822024-12-21T07:47:33.031ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4e1f1d04-ee3b-4953-bebe-bd925b71e063", "date": "Sat, 21 Dec 2024 07:47:32 GMT"} })
32832024-12-21T07:47:33.032ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) } result = Ok(())
32842024-12-21T07:47:33.032ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-666b25e00f1
32852024-12-21T07:47:33.032ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-666b25e00f1
32862024-12-21T07:47:33.032ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 76.482912ms iteration = 2 status = {}
32872024-12-21T07:47:33.033ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-666b25e00f1
32882024-12-21T07:47:33.033ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-666b25e00f1
32892024-12-21T07:47:33.036ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-666b25e00f1
32902024-12-21T07:47:33.036ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-666b25e00f1
32912024-12-21T07:47:33.037ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-666b25e00f1
32922024-12-21T07:47:33.038ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-666b25e00f1
32932024-12-21T07:47:33.039ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-666b25e00f1
32942024-12-21T07:47:33.040ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-666b25e00f1
32952024-12-21T07:47:33.045ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-666b25e00f1
32962024-12-21T07:47:33.046ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-666b25e00f1
32972024-12-21T07:47:33.048ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-666b25e00f1
32982024-12-21T07:47:33.048ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-666b25e00f1
32992024-12-21T07:47:33.051ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } uri = /v1/vpcs/default?project=proj-666b25e00f1
33002024-12-21T07:47:33.054ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 421b8a93-e2b9-43df-aa9a-1d075e1831e7, lookup_type: ByName("proj-666b25e00f1") }, key: fe06afb8-89fd-47d8-8c72-6c475bc4a160, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-666b25e00f1
33012024-12-21T07:47:33.054ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-666b25e00f1
33022024-12-21T07:47:33.054ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-666b25e00f1
33032024-12-21T07:47:33.056ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-666b25e00f1
33042024-12-21T07:47:33.056ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-666b25e00f1
33052024-12-21T07:47:33.058ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-666b25e00f1
33062024-12-21T07:47:33.058ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-666b25e00f1
33072024-12-21T07:47:33.061ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-666b25e00f1
33082024-12-21T07:47:33.061ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-666b25e00f1
33092024-12-21T07:47:33.063ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } uri = /v1/vpcs/default?project=proj-666b25e00f1
33102024-12-21T07:47:33.066ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 421b8a93-e2b9-43df-aa9a-1d075e1831e7, lookup_type: ByName("proj-666b25e00f1") }, key: fe06afb8-89fd-47d8-8c72-6c475bc4a160, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-666b25e00f1
33112024-12-21T07:47:33.066ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-666b25e00f1
33122024-12-21T07:47:33.066ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-666b25e00f1
33132024-12-21T07:47:33.068ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-666b25e00f1
33142024-12-21T07:47:33.068ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-666b25e00f1
33152024-12-21T07:47:33.080ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-666b25e00f1
33162024-12-21T07:47:33.080ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-666b25e00f1
33172024-12-21T07:47:33.082ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-666b25e00f1
33182024-12-21T07:47:33.082ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-666b25e00f1
33192024-12-21T07:47:33.085ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-666b25e00f1
33202024-12-21T07:47:33.085ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-666b25e00f1
33212024-12-21T07:47:33.088ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-666b25e00f1
33222024-12-21T07:47:33.088ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-666b25e00f1
33232024-12-21T07:47:33.091ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } uri = /v1/vpcs/default?project=proj-666b25e00f1
33242024-12-21T07:47:33.094ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 421b8a93-e2b9-43df-aa9a-1d075e1831e7, lookup_type: ByName("proj-666b25e00f1") }, key: fe06afb8-89fd-47d8-8c72-6c475bc4a160, lookup_type: ByName("default") }, key: cef8730c-417a-45a0-a05b-21bb22f5a138, lookup_type: ById(cef8730c-417a-45a0-a05b-21bb22f5a138) } result = Ok(()) uri = /v1/vpcs/default?project=proj-666b25e00f1
33252024-12-21T07:47:33.094ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-666b25e00f1
33262024-12-21T07:47:33.094ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-666b25e00f1
33272024-12-21T07:47:33.107ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-666b25e00f1
33282024-12-21T07:47:33.107ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-666b25e00f1
33292024-12-21T07:47:33.116ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-666b25e00f1
33302024-12-21T07:47:33.116ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-666b25e00f1
33312024-12-21T07:47:33.119ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-666b25e00f1
33322024-12-21T07:47:33.119ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-666b25e00f1
33332024-12-21T07:47:33.122ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-666b25e00f1
33342024-12-21T07:47:33.122ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-666b25e00f1
33352024-12-21T07:47:33.124ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-666b25e00f1
33362024-12-21T07:47:33.125ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-666b25e00f1
33372024-12-21T07:47:33.127ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-666b25e00f1
33382024-12-21T07:47:33.127ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-666b25e00f1
33392024-12-21T07:47:33.129ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } uri = /v1/vpcs/default?project=proj-666b25e00f1
33402024-12-21T07:47:33.132ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 421b8a93-e2b9-43df-aa9a-1d075e1831e7, lookup_type: ByName("proj-666b25e00f1") }, key: fe06afb8-89fd-47d8-8c72-6c475bc4a160, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-666b25e00f1
33412024-12-21T07:47:33.132ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-666b25e00f1
33422024-12-21T07:47:33.132ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-666b25e00f1
33432024-12-21T07:47:33.140ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182713 local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 457b94a5-753c-4ddc-99e0-53e5db96e813 response_code = 204 uri = /v1/vpcs/default?project=proj-666b25e00f1
33442024-12-21T07:47:33.142ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33452024-12-21T07:47:33.142ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33462024-12-21T07:47:33.143ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33472024-12-21T07:47:33.143ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33482024-12-21T07:47:33.145ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33492024-12-21T07:47:33.146ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9b209be00ecb321a38c92e6ec4fe4002342d4be6", lookup_type: ByCompositeId("token = \\"9b209be00ecb321a38c92e6ec4fe4002342d4be6\\"") } result = Ok(())
33502024-12-21T07:47:33.146ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33512024-12-21T07:47:33.146ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33522024-12-21T07:47:33.148ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33532024-12-21T07:47:33.148ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33542024-12-21T07:47:33.149ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33552024-12-21T07:47:33.149ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33562024-12-21T07:47:33.150ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33572024-12-21T07:47:33.151ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33582024-12-21T07:47:33.152ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33592024-12-21T07:47:33.153ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, lookup_type: ById(1a51fb95-9352-4c8d-9e2d-5b672a14624e) } result = Ok(())
33602024-12-21T07:47:33.154ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33612024-12-21T07:47:33.154ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33622024-12-21T07:47:33.155ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33632024-12-21T07:47:33.156ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9b209be00ecb321a38c92e6ec4fe4002342d4be6", lookup_type: ByCompositeId("9b209be00ecb321a38c92e6ec4fe4002342d4be6") } result = Ok(())
33642024-12-21T07:47:33.156ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33652024-12-21T07:47:33.156ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33662024-12-21T07:47:33.163ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33672024-12-21T07:47:33.163ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33682024-12-21T07:47:33.164ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33692024-12-21T07:47:33.164ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33702024-12-21T07:47:33.165ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33712024-12-21T07:47:33.166ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33722024-12-21T07:47:33.167ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33732024-12-21T07:47:33.167ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33742024-12-21T07:47:33.169ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33752024-12-21T07:47:33.170ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, lookup_type: ById(1a51fb95-9352-4c8d-9e2d-5b672a14624e) } result = Ok(())
33762024-12-21T07:47:33.170ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33772024-12-21T07:47:33.170ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33782024-12-21T07:47:33.171ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33792024-12-21T07:47:33.171ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33802024-12-21T07:47:33.172ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33812024-12-21T07:47:33.173ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33822024-12-21T07:47:33.174ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33832024-12-21T07:47:33.175ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) } result = Ok(())
33842024-12-21T07:47:33.175ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 roles = RoleSet { roles: {} } uri = /v1/projects/proj-666b25e00f1
33852024-12-21T07:47:33.175ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 resource = Database result = Ok(()) uri = /v1/projects/proj-666b25e00f1
33862024-12-21T07:47:33.177ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 roles = RoleSet { roles: {} } uri = /v1/projects/proj-666b25e00f1
33872024-12-21T07:47:33.177ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 resource = Database result = Ok(()) uri = /v1/projects/proj-666b25e00f1
33882024-12-21T07:47:33.178ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 roles = RoleSet { roles: {} } uri = /v1/projects/proj-666b25e00f1
33892024-12-21T07:47:33.179ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 resource = Database result = Ok(()) uri = /v1/projects/proj-666b25e00f1
33902024-12-21T07:47:33.181ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 roles = RoleSet { roles: {} } uri = /v1/projects/proj-666b25e00f1
33912024-12-21T07:47:33.181ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 resource = Database result = Ok(()) uri = /v1/projects/proj-666b25e00f1
33922024-12-21T07:47:33.183ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 roles = RoleSet { roles: {} } uri = /v1/projects/proj-666b25e00f1
33932024-12-21T07:47:33.183ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 resource = Database result = Ok(()) uri = /v1/projects/proj-666b25e00f1
33942024-12-21T07:47:33.185ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 roles = RoleSet { roles: {} } uri = /v1/projects/proj-666b25e00f1
33952024-12-21T07:47:33.185ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 resource = Database result = Ok(()) uri = /v1/projects/proj-666b25e00f1
33962024-12-21T07:47:33.188ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } uri = /v1/projects/proj-666b25e00f1
33972024-12-21T07:47:33.190ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 resource = Project { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 421b8a93-e2b9-43df-aa9a-1d075e1831e7, lookup_type: ByName("proj-666b25e00f1") } result = Ok(()) uri = /v1/projects/proj-666b25e00f1
33982024-12-21T07:47:33.190ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 roles = RoleSet { roles: {} } uri = /v1/projects/proj-666b25e00f1
33992024-12-21T07:47:33.190ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 resource = Database result = Ok(()) uri = /v1/projects/proj-666b25e00f1
34002024-12-21T07:47:33.193ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 roles = RoleSet { roles: {} } uri = /v1/projects/proj-666b25e00f1
34012024-12-21T07:47:33.193ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 resource = Database result = Ok(()) uri = /v1/projects/proj-666b25e00f1
34022024-12-21T07:47:33.195ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 roles = RoleSet { roles: {} } uri = /v1/projects/proj-666b25e00f1
34032024-12-21T07:47:33.195ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 resource = Database result = Ok(()) uri = /v1/projects/proj-666b25e00f1
34042024-12-21T07:47:33.197ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 roles = RoleSet { roles: {} } uri = /v1/projects/proj-666b25e00f1
34052024-12-21T07:47:33.198ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 resource = Database result = Ok(()) uri = /v1/projects/proj-666b25e00f1
34062024-12-21T07:47:33.200ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 roles = RoleSet { roles: {(Silo, fe5ecf26-3a15-476c-b566-aba979f13c53, "admin")} } uri = /v1/projects/proj-666b25e00f1
34072024-12-21T07:47:33.202ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 resource = Project { parent: Silo { parent: Fleet, key: fe5ecf26-3a15-476c-b566-aba979f13c53, lookup_type: ById(fe5ecf26-3a15-476c-b566-aba979f13c53) }, key: 421b8a93-e2b9-43df-aa9a-1d075e1831e7, lookup_type: ByName("proj-666b25e00f1") } result = Ok(()) uri = /v1/projects/proj-666b25e00f1
34082024-12-21T07:47:33.202ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 roles = RoleSet { roles: {} } uri = /v1/projects/proj-666b25e00f1
34092024-12-21T07:47:33.202ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 resource = Database result = Ok(()) uri = /v1/projects/proj-666b25e00f1
34102024-12-21T07:47:33.204ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 roles = RoleSet { roles: {} } uri = /v1/projects/proj-666b25e00f1
34112024-12-21T07:47:33.204ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 resource = Database result = Ok(()) uri = /v1/projects/proj-666b25e00f1
34122024-12-21T07:47:33.207ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 roles = RoleSet { roles: {} } uri = /v1/projects/proj-666b25e00f1
34132024-12-21T07:47:33.207ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 resource = Database result = Ok(()) uri = /v1/projects/proj-666b25e00f1
34142024-12-21T07:47:33.224ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 roles = RoleSet { roles: {} } uri = /v1/projects/proj-666b25e00f1
34152024-12-21T07:47:33.224ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 resource = Database result = Ok(()) uri = /v1/projects/proj-666b25e00f1
34162024-12-21T07:47:33.232ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 roles = RoleSet { roles: {} } uri = /v1/projects/proj-666b25e00f1
34172024-12-21T07:47:33.232ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 resource = Database result = Ok(()) uri = /v1/projects/proj-666b25e00f1
34182024-12-21T07:47:33.234ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 roles = RoleSet { roles: {} } uri = /v1/projects/proj-666b25e00f1
34192024-12-21T07:47:33.235ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 resource = Database result = Ok(()) uri = /v1/projects/proj-666b25e00f1
34202024-12-21T07:47:33.236ZDEBGnexus (dropshot_external): roles actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 roles = RoleSet { roles: {} } uri = /v1/projects/proj-666b25e00f1
34212024-12-21T07:47:33.237ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 1a51fb95-9352-4c8d-9e2d-5b672a14624e, silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, .. }) actor_id = 1a51fb95-9352-4c8d-9e2d-5b672a14624e authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 resource = Database result = Ok(()) uri = /v1/projects/proj-666b25e00f1
34222024-12-21T07:47:33.245ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104164 local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56045 req_id = 5a809994-1789-45ed-a059-55324e2349e3 response_code = 204 uri = /v1/projects/proj-666b25e00f1
34232024-12-21T07:47:33.503ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 2 reason = Timeout
34242024-12-21T07:47:33.503ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 2 reason = Timeout
34252024-12-21T07:47:33.503ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34262024-12-21T07:47:33.503ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34272024-12-21T07:47:33.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34282024-12-21T07:47:33.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34292024-12-21T07:47:33.505ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34302024-12-21T07:47:33.508ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34312024-12-21T07:47:33.508ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34322024-12-21T07:47:33.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34332024-12-21T07:47:33.510ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34342024-12-21T07:47:33.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34352024-12-21T07:47:33.512ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34362024-12-21T07:47:33.515ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
34372024-12-21T07:47:33.515ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34382024-12-21T07:47:33.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34392024-12-21T07:47:33.533ZINFOnexus (BackgroundTasks): found new target blueprint (first find) background_task = blueprint_loader file = nexus/src/app/background/tasks/blueprint_load.rs:88 target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
34402024-12-21T07:47:33.533ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 29.720529ms iteration = 2 status = {"enabled":false,"status":"first target blueprint","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z","time_found":"2024-12-21T07:47:33.533383674Z"}
34412024-12-21T07:47:33.533ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 2 reason = Dependency
34422024-12-21T07:47:33.533ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 2 reason = Dependency
34432024-12-21T07:47:33.533ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 3f45718f-9869-448a-a087-788e66db5e9d
34442024-12-21T07:47:33.533ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 7.081\u{b5}s iteration = 2 status = {"enabled":false,"target_id":"3f45718f-9869-448a-a087-788e66db5e9d"}
34452024-12-21T07:47:33.533ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34462024-12-21T07:47:33.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34472024-12-21T07:47:33.533ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34482024-12-21T07:47:33.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34492024-12-21T07:47:33.533ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34502024-12-21T07:47:33.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34512024-12-21T07:47:33.534ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34522024-12-21T07:47:33.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34532024-12-21T07:47:33.534ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34542024-12-21T07:47:33.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34552024-12-21T07:47:33.535ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34562024-12-21T07:47:33.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34572024-12-21T07:47:33.538ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34582024-12-21T07:47:33.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34592024-12-21T07:47:33.538ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34602024-12-21T07:47:33.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34612024-12-21T07:47:33.540ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34622024-12-21T07:47:33.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34632024-12-21T07:47:33.540ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34642024-12-21T07:47:33.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34652024-12-21T07:47:33.541ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34662024-12-21T07:47:33.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34672024-12-21T07:47:33.542ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34682024-12-21T07:47:33.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34692024-12-21T07:47:33.544ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34702024-12-21T07:47:33.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34712024-12-21T07:47:33.552ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34722024-12-21T07:47:33.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34732024-12-21T07:47:33.554ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 50.473626ms iteration = 2 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34742024-12-21T07:47:33.574ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::4]:32222/node/id
34752024-12-21T07:47:33.575ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34762024-12-21T07:47:33.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34772024-12-21T07:47:33.577ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34782024-12-21T07:47:33.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34792024-12-21T07:47:33.609ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::5]:32222/node/id
34802024-12-21T07:47:33.645ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::6]:32222/node/id
34812024-12-21T07:47:33.680ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::3]:32222/node/id
34822024-12-21T07:47:33.712ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::7]:32222/node/id
34832024-12-21T07:47:34.664ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "20a9242f-240a-4302-bfb8-ed71fb4f6c7d", "content-length": "64", "date": "Sat, 21 Dec 2024 07:47:34 GMT"} })
34842024-12-21T07:47:34.664ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34852024-12-21T07:47:34.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34862024-12-21T07:47:34.667ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34872024-12-21T07:47:34.668ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34882024-12-21T07:47:34.668ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34892024-12-21T07:47:34.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34902024-12-21T07:47:34.684ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "47e96e42-6043-494e-9fed-7721ae59f7e7", "content-length": "64", "date": "Sat, 21 Dec 2024 07:47:33 GMT"} })
34912024-12-21T07:47:34.684ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34922024-12-21T07:47:34.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34932024-12-21T07:47:34.686ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34942024-12-21T07:47:34.687ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34952024-12-21T07:47:34.687ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34962024-12-21T07:47:34.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34972024-12-21T07:47:34.704ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "426b4cdf-b569-418a-8d3f-1a169c3dea7c", "content-length": "64", "date": "Sat, 21 Dec 2024 07:47:33 GMT"} })
34982024-12-21T07:47:34.704ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34992024-12-21T07:47:34.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35002024-12-21T07:47:34.706ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35012024-12-21T07:47:34.708ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
35022024-12-21T07:47:34.708ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35032024-12-21T07:47:34.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35042024-12-21T07:47:34.750ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9030b42e-eae9-4f8b-95e9-465db0d46405", "content-length": "64", "date": "Sat, 21 Dec 2024 07:47:33 GMT"} })
35052024-12-21T07:47:34.750ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35062024-12-21T07:47:34.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35072024-12-21T07:47:34.752ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35082024-12-21T07:47:34.753ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
35092024-12-21T07:47:34.753ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35102024-12-21T07:47:34.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35112024-12-21T07:47:34.782ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a595c6e-ed2a-424e-8184-3fc7b28c3c39", "content-length": "64", "date": "Sat, 21 Dec 2024 07:47:34 GMT"} })
35122024-12-21T07:47:34.782ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35132024-12-21T07:47:34.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35142024-12-21T07:47:34.783ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35152024-12-21T07:47:34.784ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
35162024-12-21T07:47:34.784ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35172024-12-21T07:47:34.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35182024-12-21T07:47:34.793ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 1.260035912s iteration = 2 status = {"nsuccess":5}
35192024-12-21T07:47:40.758ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:44332
35202024-12-21T07:47:40.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44332 req_id = fe89ca8d-3d60-4526-a423-36f88cbbf12b roles = RoleSet { roles: {} } uri = /metrics/producers
35212024-12-21T07:47:40.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44332 req_id = fe89ca8d-3d60-4526-a423-36f88cbbf12b resource = Database result = Ok(()) uri = /metrics/producers
35222024-12-21T07:47:40.804ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = 42bd0fec-23e2-48f9-bdad-7989f94730a0
35232024-12-21T07:47:40.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45757 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44332 req_id = fe89ca8d-3d60-4526-a423-36f88cbbf12b response_code = 201 uri = /metrics/producers
35242024-12-21T07:47:43.503ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 3 reason = Timeout
35252024-12-21T07:47:43.503ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 3 reason = Timeout
35262024-12-21T07:47:43.503ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35272024-12-21T07:47:43.503ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35282024-12-21T07:47:43.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35292024-12-21T07:47:43.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35302024-12-21T07:47:43.505ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35312024-12-21T07:47:43.508ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35322024-12-21T07:47:43.508ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35332024-12-21T07:47:43.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35342024-12-21T07:47:43.509ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35352024-12-21T07:47:43.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35362024-12-21T07:47:43.511ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35372024-12-21T07:47:43.514ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
35382024-12-21T07:47:43.514ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35392024-12-21T07:47:43.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35402024-12-21T07:47:43.526ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
35412024-12-21T07:47:43.526ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.423662ms iteration = 3 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
35422024-12-21T07:47:43.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35432024-12-21T07:47:43.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35442024-12-21T07:47:43.572ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.553116ms iteration = 3 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35452024-12-21T07:47:45.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = cccb3cd7-a6e9-47ad-a06c-66f94c5439d3 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
35462024-12-21T07:47:45.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = cccb3cd7-a6e9-47ad-a06c-66f94c5439d3 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
35472024-12-21T07:47:45.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102089 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = cccb3cd7-a6e9-47ad-a06c-66f94c5439d3 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
35482024-12-21T07:47:45.449ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:63852
35492024-12-21T07:47:45.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63852 req_id = 4b7e8f5d-cb8f-45d7-a8e1-470b80bf304c roles = RoleSet { roles: {} } uri = /metrics/producers
35502024-12-21T07:47:45.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63852 req_id = 4b7e8f5d-cb8f-45d7-a8e1-470b80bf304c resource = Database result = Ok(()) uri = /metrics/producers
35512024-12-21T07:47:45.495ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = cae81b8e-6ade-45fa-953a-26f79465611b
35522024-12-21T07:47:45.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44749 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63852 req_id = 4b7e8f5d-cb8f-45d7-a8e1-470b80bf304c response_code = 201 uri = /metrics/producers
35532024-12-21T07:47:45.893ZINFOnexus (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:63928 remote_addr = [fd00:1122:3344:101::d]:33709
35542024-12-21T07:47:45.902ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6180 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = ed548b2b-4b7d-4b43-98e6-9855cc405c15 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
35552024-12-21T07:47:53.503ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 2 reason = Timeout
35562024-12-21T07:47:53.503ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
35572024-12-21T07:47:53.503ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 4 reason = Timeout
35582024-12-21T07:47:53.503ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 2 reason = Timeout
35592024-12-21T07:47:53.503ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35602024-12-21T07:47:53.503ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 2 reason = Timeout
35612024-12-21T07:47:53.503ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35622024-12-21T07:47:53.503ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 2 reason = Timeout
35632024-12-21T07:47:53.503ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 2 reason = Timeout
35642024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 4 reason = Timeout
35652024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35662024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35672024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 2 reason = Timeout
35682024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
35692024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35702024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 2 reason = Timeout
35712024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
35722024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 2 reason = Timeout
35732024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 2 reason = Timeout
35742024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35752024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35762024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 2 reason = Timeout
35772024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35782024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 2 reason = Timeout
35792024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 2 reason = Timeout
35802024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
35812024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35822024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35832024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 2 reason = Timeout
35842024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
35852024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 3 reason = Timeout
35862024-12-21T07:47:53.504ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
35872024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35882024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 4 reason = Timeout
35892024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35902024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
35912024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
35922024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
35932024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35942024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
35952024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
35962024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35972024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35982024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35992024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36002024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36012024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36022024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36032024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36042024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36052024-12-21T07:47:53.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36062024-12-21T07:47:53.508ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36072024-12-21T07:47:53.509ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36082024-12-21T07:47:53.509ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.032143ms iteration = 2 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
36092024-12-21T07:47:53.510ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 993, tv_nsec: 464522871 } })
36102024-12-21T07:47:53.510ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
36112024-12-21T07:47:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
36122024-12-21T07:47:53.512ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36132024-12-21T07:47:53.512ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 993, tv_nsec: 466910832 } })
36142024-12-21T07:47:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36152024-12-21T07:47:53.512ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
36162024-12-21T07:47:53.513ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36172024-12-21T07:47:53.513ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36182024-12-21T07:47:53.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36192024-12-21T07:47:53.516ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36202024-12-21T07:47:53.516ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36212024-12-21T07:47:53.516ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36222024-12-21T07:47:53.518ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36232024-12-21T07:47:53.519ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
36242024-12-21T07:47:53.519ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36252024-12-21T07:47:53.519ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36262024-12-21T07:47:53.519ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36272024-12-21T07:47:53.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36282024-12-21T07:47:53.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36292024-12-21T07:47:53.521ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
36302024-12-21T07:47:53.521ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
36312024-12-21T07:47:53.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36322024-12-21T07:47:53.521ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36332024-12-21T07:47:53.521ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36342024-12-21T07:47:53.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36352024-12-21T07:47:53.522ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36362024-12-21T07:47:53.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36372024-12-21T07:47:53.524ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36382024-12-21T07:47:53.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36392024-12-21T07:47:53.525ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36402024-12-21T07:47:53.525ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36412024-12-21T07:47:53.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36422024-12-21T07:47:53.526ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 993, tv_nsec: 480710748 } })
36432024-12-21T07:47:53.526ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
36442024-12-21T07:47:53.526ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36452024-12-21T07:47:53.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36462024-12-21T07:47:53.527ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36472024-12-21T07:47:53.527ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36482024-12-21T07:47:53.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36492024-12-21T07:47:53.530ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36502024-12-21T07:47:53.532ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36512024-12-21T07:47:53.532ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36522024-12-21T07:47:53.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36532024-12-21T07:47:53.558ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 54.329912ms iteration = 2 status = {"errors":[],"garbage_collect_requested":[]}
36542024-12-21T07:47:53.560ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 56.522519ms iteration = 2 status = {"errors":[],"finish_invoked_ok":[]}
36552024-12-21T07:47:53.561ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36562024-12-21T07:47:53.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36572024-12-21T07:47:53.564ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36582024-12-21T07:47:53.564ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 60.713901ms iteration = 2 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
36592024-12-21T07:47:53.564ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36602024-12-21T07:47:53.564ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
36612024-12-21T07:47:53.564ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36622024-12-21T07:47:53.564ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36632024-12-21T07:47:53.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36642024-12-21T07:47:53.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36652024-12-21T07:47:53.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36662024-12-21T07:47:53.566ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36672024-12-21T07:47:53.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36682024-12-21T07:47:53.569ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 65.228759ms iteration = 2 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
36692024-12-21T07:47:53.569ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.151418ms iteration = 4 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36702024-12-21T07:47:53.575ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36712024-12-21T07:47:53.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36722024-12-21T07:47:53.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36732024-12-21T07:47:53.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
36742024-12-21T07:47:53.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36752024-12-21T07:47:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36762024-12-21T07:47:53.586ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
36772024-12-21T07:47:53.586ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 82.883662ms iteration = 2 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
36782024-12-21T07:47:53.599ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
36792024-12-21T07:47:53.599ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 96.011736ms iteration = 4 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
36802024-12-21T07:47:53.606ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
36812024-12-21T07:47:53.606ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36822024-12-21T07:47:53.606ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "57071f97-962c-42ff-be4f-412295a49b65", "content-length": "26", "date": "Sat, 21 Dec 2024 07:47:53 GMT"} })
36832024-12-21T07:47:53.606ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36842024-12-21T07:47:53.608ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36852024-12-21T07:47:53.610ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 106.594778ms iteration = 2 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
36862024-12-21T07:47:53.612ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
36872024-12-21T07:47:53.612ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36882024-12-21T07:47:53.613ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e89436bc-7b55-439f-8477-3f105425f09d", "content-length": "26", "date": "Sat, 21 Dec 2024 07:47:53 GMT"} })
36892024-12-21T07:47:53.613ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36902024-12-21T07:47:53.614ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36912024-12-21T07:47:53.617ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36922024-12-21T07:47:53.617ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
36932024-12-21T07:47:53.617ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36942024-12-21T07:47:53.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36952024-12-21T07:47:53.650ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
36962024-12-21T07:47:53.650ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36972024-12-21T07:47:53.650ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b47c6572-9e98-49f7-b70e-20819dc275ef", "content-length": "26", "date": "Sat, 21 Dec 2024 07:47:53 GMT"} })
36982024-12-21T07:47:53.650ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36992024-12-21T07:47:53.652ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
37002024-12-21T07:47:53.694ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37012024-12-21T07:47:53.694ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
37022024-12-21T07:47:53.694ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 190.287494ms iteration = 2 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
37032024-12-21T07:47:53.700ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 196.662063ms iteration = 2 status = {}
37042024-12-21T07:47:53.702ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37052024-12-21T07:47:53.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37062024-12-21T07:47:53.703ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
37072024-12-21T07:47:53.703ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea7c6e3e-2544-4bcf-865c-23a690394473", "content-length": "1", "date": "Sat, 21 Dec 2024 07:47:53 GMT"} })
37082024-12-21T07:47:53.706ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
37092024-12-21T07:47:53.706ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37102024-12-21T07:47:53.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
37112024-12-21T07:47:53.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37122024-12-21T07:47:53.709ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 205.348402ms iteration = 2 status = null
37132024-12-21T07:47:53.711ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 207.327086ms iteration = 4 status = {"physical_disks_added":0}
37142024-12-21T07:47:53.711ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37152024-12-21T07:47:53.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
37162024-12-21T07:47:53.715ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37172024-12-21T07:47:53.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37182024-12-21T07:47:53.722ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37192024-12-21T07:47:53.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37202024-12-21T07:47:53.737ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37212024-12-21T07:47:53.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37222024-12-21T07:47:53.739ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37232024-12-21T07:47:53.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37242024-12-21T07:47:53.741ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37252024-12-21T07:47:53.744ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37262024-12-21T07:47:53.744ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37272024-12-21T07:47:53.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37282024-12-21T07:47:53.782ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
37292024-12-21T07:47:53.782ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37302024-12-21T07:47:53.782ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a9d4843-f2c9-457e-a4f2-0f0d9c3650d5", "content-length": "372", "date": "Sat, 21 Dec 2024 07:47:53 GMT"} })
37312024-12-21T07:47:53.782ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37322024-12-21T07:47:53.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37332024-12-21T07:47:53.799ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37342024-12-21T07:47:53.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37352024-12-21T07:47:53.802ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
37362024-12-21T07:47:53.802ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37372024-12-21T07:47:53.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37382024-12-21T07:47:53.817ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37392024-12-21T07:47:53.818ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37402024-12-21T07:47:53.818ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37412024-12-21T07:47:53.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37422024-12-21T07:47:53.819ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
37432024-12-21T07:47:53.822ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "381a5e54-02cc-4286-b6c9-6a1c11ae6269", "content-length": "134", "date": "Sat, 21 Dec 2024 07:47:53 GMT"} })
37442024-12-21T07:47:53.822ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
37452024-12-21T07:47:53.822ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
37462024-12-21T07:47:53.826ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
37472024-12-21T07:47:53.826ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
37482024-12-21T07:47:53.826ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "47bfffb2-32bf-402c-b54f-a5e0ace061e5", "date": "Sat, 21 Dec 2024 07:47:53 GMT"} })
37492024-12-21T07:47:53.826ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37502024-12-21T07:47:53.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37512024-12-21T07:47:53.829ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
37522024-12-21T07:47:53.829ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
37532024-12-21T07:47:53.829ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37542024-12-21T07:47:53.829ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37552024-12-21T07:47:53.829ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37562024-12-21T07:47:53.829ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37572024-12-21T07:47:53.832ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37582024-12-21T07:47:53.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37592024-12-21T07:47:53.837ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37602024-12-21T07:47:53.837ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37612024-12-21T07:47:53.837ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37622024-12-21T07:47:53.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37632024-12-21T07:47:53.837ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
37642024-12-21T07:47:53.838ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37652024-12-21T07:47:53.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37662024-12-21T07:47:53.840ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
37672024-12-21T07:47:53.841ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b640b5dd-9805-4bdc-a848-3b90da21cd65", "content-length": "2", "date": "Sat, 21 Dec 2024 07:47:53 GMT"} })
37682024-12-21T07:47:53.841ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
37692024-12-21T07:47:53.841ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "abced39c-47a3-49dc-9ed2-5a6401c33c47", "content-length": "52", "date": "Sat, 21 Dec 2024 07:47:53 GMT"} })
37702024-12-21T07:47:53.841ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
37712024-12-21T07:47:53.841ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
37722024-12-21T07:47:53.842ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
37732024-12-21T07:47:53.842ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37742024-12-21T07:47:53.846ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37752024-12-21T07:47:53.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37762024-12-21T07:47:53.854ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37772024-12-21T07:47:53.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37782024-12-21T07:47:53.856ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37792024-12-21T07:47:53.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37802024-12-21T07:47:53.859ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37812024-12-21T07:47:53.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37822024-12-21T07:47:53.862ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37832024-12-21T07:47:53.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37842024-12-21T07:47:53.865ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37852024-12-21T07:47:53.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37862024-12-21T07:47:53.871ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37872024-12-21T07:47:53.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37882024-12-21T07:47:53.877ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 993, tv_nsec: 831777189 } })
37892024-12-21T07:47:53.877ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1103
37902024-12-21T07:47:53.937ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
37912024-12-21T07:47:53.937ZDEBGnexus (MgsClient): client request background_task = service_zone_nat_tracker body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37922024-12-21T07:47:53.940ZDEBGnexus (MgsClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b411230-d40c-47ad-aa8b-59a85691ec80", "content-length": "26", "date": "Sat, 21 Dec 2024 07:47:53 GMT"} })
37932024-12-21T07:47:53.940ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37942024-12-21T07:47:53.941ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37952024-12-21T07:47:53.942ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
37962024-12-21T07:47:53.972ZDEBGnexus (DpdClient): client request background_task = service_zone_nat_tracker body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
37972024-12-21T07:47:53.973ZDEBGnexus (DpdClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0188f17-7491-4a8e-b249-e9abce5d8109", "content-length": "4", "date": "Sat, 21 Dec 2024 07:47:53 GMT"} })
37982024-12-21T07:47:53.975ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 471.034069ms iteration = 2 status = 6
37992024-12-21T07:47:53.990ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "30cba436-29b5-46dd-81eb-ed9635ec2599", "date": "Sat, 21 Dec 2024 07:47:53 GMT"} })
38002024-12-21T07:47:53.990ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
38012024-12-21T07:47:53.990ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
38022024-12-21T07:47:53.990ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "427ab1bf-8e31-44b4-ba53-4e5b2ef34694", "date": "Sat, 21 Dec 2024 07:47:53 GMT"} })
38032024-12-21T07:47:53.992ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 488.099601ms iteration = 3 status = {}
38042024-12-21T07:47:54.000ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d5a36e4-defb-42fa-8b84-55a3e1f67c47", "content-length": "539", "date": "Sat, 21 Dec 2024 07:47:53 GMT"} })
38052024-12-21T07:47:54.000ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38062024-12-21T07:47:54.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38072024-12-21T07:47:54.001ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf2fea43-a988-471b-8de2-238dd9f54903", "content-length": "691", "date": "Sat, 21 Dec 2024 07:47:53 GMT"} })
38082024-12-21T07:47:54.001ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
38092024-12-21T07:47:54.001ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
38102024-12-21T07:47:54.001ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
38112024-12-21T07:47:54.003ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 499.014539ms iteration = 2 status = {}
38122024-12-21T07:47:54.027ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38132024-12-21T07:47:54.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38142024-12-21T07:47:54.030ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38152024-12-21T07:47:54.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38162024-12-21T07:47:54.032ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38172024-12-21T07:47:54.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38182024-12-21T07:47:54.035ZWARNnexus (BackgroundTasks): no bootstore config found in db background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1229 key = network_key rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
38192024-12-21T07:47:54.035ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38202024-12-21T07:47:54.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38212024-12-21T07:47:54.041ZINFOnexus (BackgroundTasks): updating bootstore config background_task = switch_port_config_manager config = EarlyNetworkConfig { body: EarlyNetworkConfigBody { ntp_servers: ["0.pool.ntp.org"], rack_network_config: Some(RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], autoneg: false, bgp_peers: [], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None }], switch: Switch0, tx_eq: None, uplink_port_fec: Some(None), uplink_port_speed: Speed40G }], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 } }) }, generation: 2, schema_version: 2 } file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1286 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
38222024-12-21T07:47:54.041ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = PUT rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
38232024-12-21T07:47:54.044ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 204, headers: {"x-request-id": "6736795b-73bd-4f48-ae49-94bc1021e8ca", "date": "Sat, 21 Dec 2024 07:47:54 GMT"} })
38242024-12-21T07:47:54.044ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38252024-12-21T07:47:54.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38262024-12-21T07:47:54.057ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 553.139457ms iteration = 2 status = {}
38272024-12-21T07:47:54.230ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:35606
38282024-12-21T07:47:54.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35606 req_id = 1dde726e-69f8-4800-b461-0ab21a50d841 roles = RoleSet { roles: {} } uri = /metrics/producers
38292024-12-21T07:47:54.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35606 req_id = 1dde726e-69f8-4800-b461-0ab21a50d841 resource = Database result = Ok(()) uri = /metrics/producers
38302024-12-21T07:47:54.262ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
38312024-12-21T07:47:54.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32049 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35606 req_id = 1dde726e-69f8-4800-b461-0ab21a50d841 response_code = 201 uri = /metrics/producers
38322024-12-21T07:47:54.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 2ce3fb67-353e-4647-a395-c1d0f471302c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
38332024-12-21T07:47:54.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 2ce3fb67-353e-4647-a395-c1d0f471302c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
38342024-12-21T07:47:54.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4349 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 2ce3fb67-353e-4647-a395-c1d0f471302c response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
38352024-12-21T07:47:54.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = e89ed333-719c-4bda-9036-123f28b4d197 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
38362024-12-21T07:47:54.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = e89ed333-719c-4bda-9036-123f28b4d197 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
38372024-12-21T07:47:54.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8810 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = e89ed333-719c-4bda-9036-123f28b4d197 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
38382024-12-21T07:47:55.894ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1256 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = c7616404-564d-495a-acb0-88e0b7b4fbbe response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
38392024-12-21T07:47:56.015ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:41626
38402024-12-21T07:47:56.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41626 req_id = 9c245a24-0124-4174-beab-6f6a58d99687 roles = RoleSet { roles: {} } uri = /metrics/producers
38412024-12-21T07:47:56.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41626 req_id = 9c245a24-0124-4174-beab-6f6a58d99687 resource = Database result = Ok(()) uri = /metrics/producers
38422024-12-21T07:47:56.067ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = 9ad898a3-6e9f-4617-bdb6-642b625a79d4
38432024-12-21T07:47:56.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52437 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41626 req_id = 9c245a24-0124-4174-beab-6f6a58d99687 response_code = 201 uri = /metrics/producers
38442024-12-21T07:48:03.503ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 5 reason = Timeout
38452024-12-21T07:48:03.503ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 5 reason = Timeout
38462024-12-21T07:48:03.503ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38472024-12-21T07:48:03.503ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38482024-12-21T07:48:03.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38492024-12-21T07:48:03.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38502024-12-21T07:48:03.505ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38512024-12-21T07:48:03.508ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38522024-12-21T07:48:03.508ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38532024-12-21T07:48:03.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38542024-12-21T07:48:03.509ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38552024-12-21T07:48:03.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38562024-12-21T07:48:03.514ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38572024-12-21T07:48:03.518ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
38582024-12-21T07:48:03.518ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38592024-12-21T07:48:03.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38602024-12-21T07:48:03.532ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
38612024-12-21T07:48:03.532ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.761623ms iteration = 5 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
38622024-12-21T07:48:03.537ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38632024-12-21T07:48:03.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38642024-12-21T07:48:03.570ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 67.250954ms iteration = 5 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38652024-12-21T07:48:03.629ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:50518
38662024-12-21T07:48:03.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50518 req_id = 8d5de628-a71f-437d-bc50-a17bac3c541b roles = RoleSet { roles: {} } uri = /metrics/producers
38672024-12-21T07:48:03.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50518 req_id = 8d5de628-a71f-437d-bc50-a17bac3c541b resource = Database result = Ok(()) uri = /metrics/producers
38682024-12-21T07:48:03.637ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = 34be787b-2c60-4915-afd0-2c1a7062ad84
38692024-12-21T07:48:03.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7120 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50518 req_id = 8d5de628-a71f-437d-bc50-a17bac3c541b response_code = 201 uri = /metrics/producers
38702024-12-21T07:48:05.893ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1152 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 7f84dfeb-e1d5-474e-809a-a8114fa494f6 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
38712024-12-21T07:48:13.503ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 6 reason = Timeout
38722024-12-21T07:48:13.503ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 6 reason = Timeout
38732024-12-21T07:48:13.503ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38742024-12-21T07:48:13.503ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38752024-12-21T07:48:13.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38762024-12-21T07:48:13.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38772024-12-21T07:48:13.506ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38782024-12-21T07:48:13.508ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38792024-12-21T07:48:13.508ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38802024-12-21T07:48:13.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38812024-12-21T07:48:13.510ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38822024-12-21T07:48:13.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38832024-12-21T07:48:13.512ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38842024-12-21T07:48:13.515ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
38852024-12-21T07:48:13.515ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38862024-12-21T07:48:13.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38872024-12-21T07:48:13.525ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
38882024-12-21T07:48:13.525ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.375863ms iteration = 6 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
38892024-12-21T07:48:13.537ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38902024-12-21T07:48:13.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38912024-12-21T07:48:13.565ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.099895ms iteration = 6 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38922024-12-21T07:48:15.894ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1645 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 5b4f9a8d-4016-426f-bee0-ea4f5d835d71 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
38932024-12-21T07:48:23.502ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
38942024-12-21T07:48:23.502ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
38952024-12-21T07:48:23.502ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38962024-12-21T07:48:23.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38972024-12-21T07:48:23.503ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 3 reason = Timeout
38982024-12-21T07:48:23.503ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38992024-12-21T07:48:23.503ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 2 reason = Timeout
39002024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39012024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 3 reason = Timeout
39022024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
39032024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 7 reason = Timeout
39042024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
39052024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39062024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 7 reason = Timeout
39072024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39082024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
39092024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
39102024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 2 reason = Timeout
39112024-12-21T07:48:23.504ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:38:23.504053770 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
39122024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
39132024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 2 reason = Timeout
39142024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
39152024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 3 reason = Timeout
39162024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 3 reason = Timeout
39172024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
39182024-12-21T07:48:23.504ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 3f45718f-9869-448a-a087-788e66db5e9d
39192024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 3 reason = Timeout
39202024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.16\u{b5}s iteration = 3 status = {"enabled":false,"target_id":"3f45718f-9869-448a-a087-788e66db5e9d"}
39212024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39222024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 3 reason = Timeout
39232024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
39242024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 4 reason = Timeout
39252024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 3 reason = Timeout
39262024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39272024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 3 reason = Timeout
39282024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Timeout
39292024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 3 reason = Timeout
39302024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 3 reason = Timeout
39312024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39322024-12-21T07:48:23.504ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
39332024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39342024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39352024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 2 reason = Timeout
39362024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39372024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
39382024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 2 reason = Timeout
39392024-12-21T07:48:23.504ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
39402024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
39412024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 3 reason = Timeout
39422024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
39432024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39442024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 5 reason = Timeout
39452024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39462024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39472024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 3 reason = Timeout
39482024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 3 reason = Timeout
39492024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
39502024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 3 reason = Timeout
39512024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39522024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
39532024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39542024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 4 reason = Timeout
39552024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
39562024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
39572024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39582024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39592024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39602024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
39612024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39622024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
39632024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
39642024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
39652024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
39662024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39672024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
39682024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39692024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39702024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39712024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
39722024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39732024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39742024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
39752024-12-21T07:48:23.504ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1595c632-cfae-4f6b-937d-d413dd8cf0b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1023, tv_nsec: 458947755 } })
39762024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39772024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39782024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
39792024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39802024-12-21T07:48:23.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39812024-12-21T07:48:23.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39822024-12-21T07:48:23.505ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("481de7e8-0737-474b-8c33-e6e8bc6477be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("683a9892-43cd-4dd8-a983-26cccd988df0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1023, tv_nsec: 459101918 } })
39832024-12-21T07:48:23.505ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
39842024-12-21T07:48:23.505ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.408554ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
39852024-12-21T07:48:23.505ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
39862024-12-21T07:48:23.505ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.615057ms iteration = 3 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
39872024-12-21T07:48:23.507ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39882024-12-21T07:48:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39892024-12-21T07:48:23.508ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39902024-12-21T07:48:23.510ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:38:23.504053770 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
39912024-12-21T07:48:23.510ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 6.43051ms iteration = 2 status = {"expiration":"2024-12-21T07:38:23.504053770Z","pruned":[]}
39922024-12-21T07:48:23.510ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39932024-12-21T07:48:23.510ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1023, tv_nsec: 464781935 } })
39942024-12-21T07:48:23.511ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
39952024-12-21T07:48:23.511ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 7.186953ms iteration = 2 status = {"errors":[],"found_port_ok":[]}
39962024-12-21T07:48:23.511ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 7.138632ms iteration = 3 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
39972024-12-21T07:48:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
39982024-12-21T07:48:23.513ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
39992024-12-21T07:48:23.513ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
40002024-12-21T07:48:23.513ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
40012024-12-21T07:48:23.513ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40022024-12-21T07:48:23.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40032024-12-21T07:48:23.514ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40042024-12-21T07:48:23.514ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40052024-12-21T07:48:23.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40062024-12-21T07:48:23.518ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 14.192734ms iteration = 3 status = {"errors":[],"garbage_collect_requested":[]}
40072024-12-21T07:48:23.519ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40082024-12-21T07:48:23.519ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40092024-12-21T07:48:23.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40102024-12-21T07:48:23.521ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1023, tv_nsec: 475788004 } })
40112024-12-21T07:48:23.521ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40122024-12-21T07:48:23.521ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40132024-12-21T07:48:23.522ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
40142024-12-21T07:48:23.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40152024-12-21T07:48:23.522ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40162024-12-21T07:48:23.525ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40172024-12-21T07:48:23.525ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40182024-12-21T07:48:23.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40192024-12-21T07:48:23.527ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40202024-12-21T07:48:23.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40212024-12-21T07:48:23.537ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40222024-12-21T07:48:23.538ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40232024-12-21T07:48:23.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40242024-12-21T07:48:23.539ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40252024-12-21T07:48:23.539ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40262024-12-21T07:48:23.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40272024-12-21T07:48:23.541ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40282024-12-21T07:48:23.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40292024-12-21T07:48:23.543ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40302024-12-21T07:48:23.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40312024-12-21T07:48:23.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40322024-12-21T07:48:23.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40332024-12-21T07:48:23.563ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40342024-12-21T07:48:23.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
40352024-12-21T07:48:23.566ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40362024-12-21T07:48:23.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40372024-12-21T07:48:23.567ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 63.495819ms iteration = 5 status = {"physical_disks_added":0}
40382024-12-21T07:48:23.568ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40392024-12-21T07:48:23.572ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40402024-12-21T07:48:23.572ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
40412024-12-21T07:48:23.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40422024-12-21T07:48:23.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40432024-12-21T07:48:23.575ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
40442024-12-21T07:48:23.576ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40452024-12-21T07:48:23.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40462024-12-21T07:48:23.579ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 75.327712ms iteration = 3 status = {"errors":[],"finish_invoked_ok":[]}
40472024-12-21T07:48:23.584ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1023, tv_nsec: 538622252 } })
40482024-12-21T07:48:23.584ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40492024-12-21T07:48:23.584ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
40502024-12-21T07:48:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40512024-12-21T07:48:23.588ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 83.913749ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
40522024-12-21T07:48:23.588ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40532024-12-21T07:48:23.589ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
40542024-12-21T07:48:23.589ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 85.569497ms iteration = 3 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
40552024-12-21T07:48:23.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
40562024-12-21T07:48:23.591ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
40572024-12-21T07:48:23.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
40582024-12-21T07:48:23.604ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40592024-12-21T07:48:23.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40602024-12-21T07:48:23.606ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 102.460317ms iteration = 7 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40612024-12-21T07:48:23.607ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40622024-12-21T07:48:23.607ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
40632024-12-21T07:48:23.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40642024-12-21T07:48:23.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40652024-12-21T07:48:23.607ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 103.17729ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
40662024-12-21T07:48:23.608ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40672024-12-21T07:48:23.609ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
40682024-12-21T07:48:23.609ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
40692024-12-21T07:48:23.609ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 105.049222ms iteration = 2 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
40702024-12-21T07:48:23.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40712024-12-21T07:48:23.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40722024-12-21T07:48:23.612ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40732024-12-21T07:48:23.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40742024-12-21T07:48:23.613ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40752024-12-21T07:48:23.614ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40762024-12-21T07:48:23.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
40772024-12-21T07:48:23.617ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40782024-12-21T07:48:23.617ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
40792024-12-21T07:48:23.617ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40802024-12-21T07:48:23.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40812024-12-21T07:48:23.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40822024-12-21T07:48:23.618ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
40832024-12-21T07:48:23.618ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 114.303831ms iteration = 7 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
40842024-12-21T07:48:23.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
40852024-12-21T07:48:23.619ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40862024-12-21T07:48:23.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40872024-12-21T07:48:23.633ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40882024-12-21T07:48:23.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40892024-12-21T07:48:23.636ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
40902024-12-21T07:48:23.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
40912024-12-21T07:48:23.636ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40922024-12-21T07:48:23.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40932024-12-21T07:48:23.662ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
40942024-12-21T07:48:23.662ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40952024-12-21T07:48:23.663ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc93951a-4496-4158-acda-0366168acd3d", "content-length": "26", "date": "Sat, 21 Dec 2024 07:48:23 GMT"} })
40962024-12-21T07:48:23.663ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40972024-12-21T07:48:23.664ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
40982024-12-21T07:48:23.664ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40992024-12-21T07:48:23.664ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a370fd5-0bb5-41e6-8ac6-1e9b59c5e4b5", "content-length": "26", "date": "Sat, 21 Dec 2024 07:48:23 GMT"} })
41002024-12-21T07:48:23.664ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41012024-12-21T07:48:23.665ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41022024-12-21T07:48:23.666ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41032024-12-21T07:48:23.673ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
41042024-12-21T07:48:23.673ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
41052024-12-21T07:48:23.673ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
41062024-12-21T07:48:23.673ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41072024-12-21T07:48:23.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41082024-12-21T07:48:23.676ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41092024-12-21T07:48:23.676ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
41102024-12-21T07:48:23.676ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
41112024-12-21T07:48:23.676ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 172.247124ms iteration = 2 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
41122024-12-21T07:48:23.677ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41132024-12-21T07:48:23.677ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
41142024-12-21T07:48:23.677ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41152024-12-21T07:48:23.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41162024-12-21T07:48:23.680ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
41172024-12-21T07:48:23.680ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41182024-12-21T07:48:23.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41192024-12-21T07:48:23.682ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
41202024-12-21T07:48:23.682ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
41212024-12-21T07:48:23.682ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41222024-12-21T07:48:23.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41232024-12-21T07:48:23.684ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 180.70738ms iteration = 3 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
41242024-12-21T07:48:23.717ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
41252024-12-21T07:48:23.722ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41262024-12-21T07:48:23.722ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
41272024-12-21T07:48:23.725ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
41282024-12-21T07:48:23.725ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41292024-12-21T07:48:23.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41302024-12-21T07:48:23.735ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
41312024-12-21T07:48:23.735ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 0 version = 2
41322024-12-21T07:48:23.735ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41332024-12-21T07:48:23.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41342024-12-21T07:48:23.738ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41352024-12-21T07:48:23.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41362024-12-21T07:48:23.743ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41372024-12-21T07:48:23.743ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
41382024-12-21T07:48:23.743ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 238.741075ms iteration = 3 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
41392024-12-21T07:48:23.794ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
41402024-12-21T07:48:23.794ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 289.951972ms iteration = 2 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
41412024-12-21T07:48:23.838ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
41422024-12-21T07:48:23.838ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "95d319e0-0c58-4b61-a71e-b9edf7cbcdad", "content-length": "1", "date": "Sat, 21 Dec 2024 07:48:22 GMT"} })
41432024-12-21T07:48:23.839ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
41442024-12-21T07:48:23.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41452024-12-21T07:48:23.864ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
41462024-12-21T07:48:23.864ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41472024-12-21T07:48:23.864ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9213d50f-d3a8-41d2-98f6-55ff4f94ab82", "content-length": "26", "date": "Sat, 21 Dec 2024 07:48:23 GMT"} })
41482024-12-21T07:48:23.864ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41492024-12-21T07:48:23.865ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
41502024-12-21T07:48:23.880ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
41512024-12-21T07:48:23.880ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41522024-12-21T07:48:23.881ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1b2b5c1-2687-4952-9d10-28cafdde0bb6", "content-length": "372", "date": "Sat, 21 Dec 2024 07:48:23 GMT"} })
41532024-12-21T07:48:23.881ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41542024-12-21T07:48:23.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41552024-12-21T07:48:23.884ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41562024-12-21T07:48:23.887ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 383.438796ms iteration = 3 status = null
41572024-12-21T07:48:23.888ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
41582024-12-21T07:48:23.888ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41592024-12-21T07:48:23.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41602024-12-21T07:48:23.892ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 1 version = 2
41612024-12-21T07:48:23.892ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
41622024-12-21T07:48:23.892ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 07:47:25.290148 UTC dns_group = external generation = 2
41632024-12-21T07:48:23.892ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 388.194078ms iteration = 3 status = {"generation":2}
41642024-12-21T07:48:23.903ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 399.294398ms iteration = 3 status = {}
41652024-12-21T07:48:23.905ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41662024-12-21T07:48:23.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41672024-12-21T07:48:23.908ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41682024-12-21T07:48:23.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41692024-12-21T07:48:23.917ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41702024-12-21T07:48:23.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41712024-12-21T07:48:23.921ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41722024-12-21T07:48:23.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41732024-12-21T07:48:23.928ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41742024-12-21T07:48:23.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41752024-12-21T07:48:23.934ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
41762024-12-21T07:48:23.935ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "669b0eba-51dd-4546-ada0-f31c4a62eb94", "date": "Sat, 21 Dec 2024 07:48:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
41772024-12-21T07:48:23.935ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
41782024-12-21T07:48:23.936ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b2aae907-df64-430a-a11b-dbdaec8994e1", "date": "Sat, 21 Dec 2024 07:48:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
41792024-12-21T07:48:23.936ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
41802024-12-21T07:48:23.938ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
41812024-12-21T07:48:23.938ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 434.171086ms iteration = 4 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
41822024-12-21T07:48:23.943ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41832024-12-21T07:48:23.946ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
41842024-12-21T07:48:23.946ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
41852024-12-21T07:48:23.946ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41862024-12-21T07:48:23.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41872024-12-21T07:48:23.949ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 445.178865ms iteration = 3 status = 0
41882024-12-21T07:48:23.951ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
41892024-12-21T07:48:23.952ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
41902024-12-21T07:48:23.952ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "120bf959-442e-44bd-9198-1f86911825e2", "date": "Sat, 21 Dec 2024 07:48:23 GMT"} })
41912024-12-21T07:48:23.952ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41922024-12-21T07:48:23.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41932024-12-21T07:48:23.955ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41942024-12-21T07:48:23.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41952024-12-21T07:48:23.957ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41962024-12-21T07:48:23.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41972024-12-21T07:48:23.961ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
41982024-12-21T07:48:23.961ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41992024-12-21T07:48:23.961ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1f79402a-4a68-4b61-972d-54b60f6302f0", "date": "Sat, 21 Dec 2024 07:48:23 GMT"} })
42002024-12-21T07:48:23.963ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 458.936251ms iteration = 4 status = {}
42012024-12-21T07:48:23.965ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42022024-12-21T07:48:23.967ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
42032024-12-21T07:48:23.967ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42042024-12-21T07:48:23.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42052024-12-21T07:48:23.999ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42062024-12-21T07:48:23.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42072024-12-21T07:48:24.001ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42082024-12-21T07:48:24.002ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:47:21.583817Z, time_modified: 2024-12-21T07:47:21.583817Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
42092024-12-21T07:48:24.002ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 498.078182ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]}},"default_endpoint":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
42102024-12-21T07:48:24.003ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
42112024-12-21T07:48:24.003ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42122024-12-21T07:48:24.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42132024-12-21T07:48:24.005ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42142024-12-21T07:48:24.007ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
42152024-12-21T07:48:24.007ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42162024-12-21T07:48:24.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42172024-12-21T07:48:24.016ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
42182024-12-21T07:48:24.016ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "7c447c16-8bbc-4fd6-8cd6-6d43feacb0f3", "date": "Sat, 21 Dec 2024 07:48:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
42192024-12-21T07:48:24.016ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
42202024-12-21T07:48:24.018ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "4c346acb-756b-4d10-b419-15b5c7a0ec02", "date": "Sat, 21 Dec 2024 07:48:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
42212024-12-21T07:48:24.018ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
42222024-12-21T07:48:24.020ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "58a699ba-bcae-4a0f-ac61-827f2f8efd9a", "date": "Sat, 21 Dec 2024 07:48:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
42232024-12-21T07:48:24.020ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
42242024-12-21T07:48:24.022ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
42252024-12-21T07:48:24.022ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 517.653358ms iteration = 4 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
42262024-12-21T07:48:24.030ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
42272024-12-21T07:48:24.030ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
42282024-12-21T07:48:24.030ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 07:47:23.936594 UTC dns_group = internal generation = 1
42292024-12-21T07:48:24.030ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 528.331202ms iteration = 3 status = {"generation":1}
42302024-12-21T07:48:24.080ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
42312024-12-21T07:48:24.089ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42322024-12-21T07:48:24.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42332024-12-21T07:48:24.091ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
42342024-12-21T07:48:24.091ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42352024-12-21T07:48:24.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42362024-12-21T07:48:24.103ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
42372024-12-21T07:48:24.104ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "64448c3e-00ed-4b23-b5c0-942332d05317", "content-length": "134", "date": "Sat, 21 Dec 2024 07:48:23 GMT"} })
42382024-12-21T07:48:24.104ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
42392024-12-21T07:48:24.104ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
42402024-12-21T07:48:24.104ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
42412024-12-21T07:48:24.104ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
42422024-12-21T07:48:24.104ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42432024-12-21T07:48:24.104ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42442024-12-21T07:48:24.104ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42452024-12-21T07:48:24.104ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
42462024-12-21T07:48:24.104ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42472024-12-21T07:48:24.104ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
42482024-12-21T07:48:24.104ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
42492024-12-21T07:48:24.104ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42502024-12-21T07:48:24.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42512024-12-21T07:48:24.107ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "483aa347-fccf-442c-9122-1bddcd45edda", "content-length": "691", "date": "Sat, 21 Dec 2024 07:48:24 GMT"} })
42522024-12-21T07:48:24.107ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
42532024-12-21T07:48:24.107ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
42542024-12-21T07:48:24.107ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
42552024-12-21T07:48:24.107ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
42562024-12-21T07:48:24.107ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "55c7aeb8-7a63-4451-8ebd-e512bccb141e", "content-length": "2", "date": "Sat, 21 Dec 2024 07:48:23 GMT"} })
42572024-12-21T07:48:24.107ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
42582024-12-21T07:48:24.108ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "07af44cb-19aa-4c6e-b3f3-e80606349b61", "content-length": "52", "date": "Sat, 21 Dec 2024 07:48:23 GMT"} })
42592024-12-21T07:48:24.108ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
42602024-12-21T07:48:24.108ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
42612024-12-21T07:48:24.109ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 605.126689ms iteration = 3 status = {}
42622024-12-21T07:48:24.294ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f7fe5650-09b8-43c2-8c00-c50ceba4f85b", "date": "Sat, 21 Dec 2024 07:48:24 GMT"} })
42632024-12-21T07:48:24.294ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
42642024-12-21T07:48:24.294ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
42652024-12-21T07:48:24.295ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f911f995-22a4-4ce8-acd8-6c731c311945", "content-length": "682", "date": "Sat, 21 Dec 2024 07:48:24 GMT"} })
42662024-12-21T07:48:24.297ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42672024-12-21T07:48:24.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42682024-12-21T07:48:24.301ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42692024-12-21T07:48:24.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42702024-12-21T07:48:24.304ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42712024-12-21T07:48:24.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42722024-12-21T07:48:24.307ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42732024-12-21T07:48:24.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42742024-12-21T07:48:24.314ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 809.8475ms iteration = 3 status = {}
42752024-12-21T07:48:24.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = b1841bc8-b683-41a1-a1c0-2e6cffdd0ff5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
42762024-12-21T07:48:24.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = b1841bc8-b683-41a1-a1c0-2e6cffdd0ff5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
42772024-12-21T07:48:24.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3929 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = b1841bc8-b683-41a1-a1c0-2e6cffdd0ff5 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
42782024-12-21T07:48:25.893ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1097 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = d3a14d35-3a15-48ac-8152-0987d9a0f058 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
42792024-12-21T07:48:33.505ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 8 reason = Timeout
42802024-12-21T07:48:33.505ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 8 reason = Timeout
42812024-12-21T07:48:33.505ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42822024-12-21T07:48:33.506ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42832024-12-21T07:48:33.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42842024-12-21T07:48:33.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42852024-12-21T07:48:33.508ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42862024-12-21T07:48:33.510ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42872024-12-21T07:48:33.510ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42882024-12-21T07:48:33.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42892024-12-21T07:48:33.513ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42902024-12-21T07:48:33.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42912024-12-21T07:48:33.515ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42922024-12-21T07:48:33.518ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
42932024-12-21T07:48:33.518ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42942024-12-21T07:48:33.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42952024-12-21T07:48:33.531ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
42962024-12-21T07:48:33.531ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.986115ms iteration = 8 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
42972024-12-21T07:48:33.536ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42982024-12-21T07:48:33.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42992024-12-21T07:48:33.537ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.992169ms iteration = 8 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43002024-12-21T07:48:35.895ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1062 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 086f2ccc-68ac-42c1-b72b-38a954b63d77 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
43012024-12-21T07:48:43.505ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 9 reason = Timeout
43022024-12-21T07:48:43.505ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 9 reason = Timeout
43032024-12-21T07:48:43.505ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43042024-12-21T07:48:43.505ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43052024-12-21T07:48:43.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43062024-12-21T07:48:43.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43072024-12-21T07:48:43.508ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43082024-12-21T07:48:43.510ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43092024-12-21T07:48:43.510ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43102024-12-21T07:48:43.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43112024-12-21T07:48:43.513ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43122024-12-21T07:48:43.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43132024-12-21T07:48:43.514ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43142024-12-21T07:48:43.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
43152024-12-21T07:48:43.516ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43162024-12-21T07:48:43.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43172024-12-21T07:48:43.530ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
43182024-12-21T07:48:43.530ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.110411ms iteration = 9 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
43192024-12-21T07:48:43.535ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43202024-12-21T07:48:43.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43212024-12-21T07:48:43.537ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.688533ms iteration = 9 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43222024-12-21T07:48:45.895ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1117 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 474f777b-92db-40c2-bb9c-15c76f87f7ee response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
43232024-12-21T07:48:50.883ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:58236
43242024-12-21T07:48:50.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = da3c4d09-b972-47b1-995d-36e9e50192a4 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
43252024-12-21T07:48:50.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = da3c4d09-b972-47b1-995d-36e9e50192a4 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
43262024-12-21T07:48:50.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3373 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = da3c4d09-b972-47b1-995d-36e9e50192a4 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
43272024-12-21T07:48:50.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = b74e745f-7d1e-4616-85b7-d10c1af5010b roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
43282024-12-21T07:48:50.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = b74e745f-7d1e-4616-85b7-d10c1af5010b resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
43292024-12-21T07:48:50.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3274 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = b74e745f-7d1e-4616-85b7-d10c1af5010b response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
43302024-12-21T07:48:53.505ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 4 reason = Timeout
43312024-12-21T07:48:53.505ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
43322024-12-21T07:48:53.505ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Timeout
43332024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43342024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
43352024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
43362024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
43372024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43382024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
43392024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43402024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
43412024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
43422024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
43432024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
43442024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
43452024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
43462024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43472024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
43482024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 4 reason = Timeout
43492024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
43502024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43512024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43522024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
43532024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43542024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
43552024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
43562024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
43572024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
43582024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43592024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
43602024-12-21T07:48:53.506ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
43612024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43622024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
43632024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43642024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
43652024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43662024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43672024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
43682024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
43692024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43702024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43712024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43722024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
43732024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43742024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43752024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43762024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43772024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43782024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43792024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43802024-12-21T07:48:53.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43812024-12-21T07:48:53.509ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.233505ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
43822024-12-21T07:48:53.510ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43832024-12-21T07:48:53.514ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
43842024-12-21T07:48:53.514ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43852024-12-21T07:48:53.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43862024-12-21T07:48:53.517ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43872024-12-21T07:48:53.517ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43882024-12-21T07:48:53.520ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43892024-12-21T07:48:53.520ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
43902024-12-21T07:48:53.520ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43912024-12-21T07:48:53.520ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43922024-12-21T07:48:53.520ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43932024-12-21T07:48:53.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43942024-12-21T07:48:53.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43952024-12-21T07:48:53.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43962024-12-21T07:48:53.524ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1053, tv_nsec: 476427015 } })
43972024-12-21T07:48:53.524ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
43982024-12-21T07:48:53.525ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43992024-12-21T07:48:53.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44002024-12-21T07:48:53.528ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1053, tv_nsec: 480856041 } })
44012024-12-21T07:48:53.528ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
44022024-12-21T07:48:53.531ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44032024-12-21T07:48:53.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44042024-12-21T07:48:53.552ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 46.167772ms iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
44052024-12-21T07:48:53.559ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44062024-12-21T07:48:53.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
44072024-12-21T07:48:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
44082024-12-21T07:48:53.560ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44092024-12-21T07:48:53.560ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
44102024-12-21T07:48:53.560ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44112024-12-21T07:48:53.561ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
44122024-12-21T07:48:53.561ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
44132024-12-21T07:48:53.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44142024-12-21T07:48:53.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
44152024-12-21T07:48:53.563ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 58.284009ms iteration = 4 status = {"errors":[],"finish_invoked_ok":[]}
44162024-12-21T07:48:53.569ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44172024-12-21T07:48:53.570ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
44182024-12-21T07:48:53.570ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 64.062129ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
44192024-12-21T07:48:53.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44202024-12-21T07:48:53.571ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.781891ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44212024-12-21T07:48:53.571ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44222024-12-21T07:48:53.573ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44232024-12-21T07:48:53.573ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44242024-12-21T07:48:53.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44252024-12-21T07:48:53.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44262024-12-21T07:48:53.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44272024-12-21T07:48:53.577ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44282024-12-21T07:48:53.577ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44292024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44302024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44312024-12-21T07:48:53.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44322024-12-21T07:48:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44332024-12-21T07:48:53.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44342024-12-21T07:48:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44352024-12-21T07:48:53.581ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44362024-12-21T07:48:53.582ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44372024-12-21T07:48:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44382024-12-21T07:48:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44392024-12-21T07:48:53.583ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44402024-12-21T07:48:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44412024-12-21T07:48:53.584ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
44422024-12-21T07:48:53.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
44432024-12-21T07:48:53.585ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44442024-12-21T07:48:53.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44452024-12-21T07:48:53.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44462024-12-21T07:48:53.586ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 80.721534ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
44472024-12-21T07:48:53.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
44482024-12-21T07:48:53.588ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44492024-12-21T07:48:53.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44502024-12-21T07:48:53.592ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 86.541454ms iteration = 4 status = 0
44512024-12-21T07:48:53.607ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44522024-12-21T07:48:53.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44532024-12-21T07:48:53.618ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 112.903787ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
44542024-12-21T07:48:53.620ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44552024-12-21T07:48:53.620ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
44562024-12-21T07:48:53.620ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44572024-12-21T07:48:53.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44582024-12-21T07:48:53.638ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1053, tv_nsec: 590580603 } })
44592024-12-21T07:48:53.638ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
44602024-12-21T07:48:53.643ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 137.845854ms iteration = 6 status = {"physical_disks_added":0}
44612024-12-21T07:48:53.646ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44622024-12-21T07:48:53.648ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
44632024-12-21T07:48:53.648ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44642024-12-21T07:48:53.648ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc0ebe01-81e6-491b-8c48-27ff8df5f8d3", "content-length": "26", "date": "Sat, 21 Dec 2024 07:48:53 GMT"} })
44652024-12-21T07:48:53.648ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44662024-12-21T07:48:53.650ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
44672024-12-21T07:48:53.650ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44682024-12-21T07:48:53.650ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
44692024-12-21T07:48:53.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44702024-12-21T07:48:53.654ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 148.541908ms iteration = 4 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
44712024-12-21T07:48:53.661ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
44722024-12-21T07:48:53.661ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 155.454927ms iteration = 10 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
44732024-12-21T07:48:53.665ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44742024-12-21T07:48:53.665ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
44752024-12-21T07:48:53.665ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 159.546447ms iteration = 4 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
44762024-12-21T07:48:53.666ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
44772024-12-21T07:48:53.666ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44782024-12-21T07:48:53.667ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "179a8960-80e0-4001-90c4-6c568a2eebd9", "content-length": "26", "date": "Sat, 21 Dec 2024 07:48:53 GMT"} })
44792024-12-21T07:48:53.667ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44802024-12-21T07:48:53.669ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44812024-12-21T07:48:53.673ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44822024-12-21T07:48:53.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44832024-12-21T07:48:53.737ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
44842024-12-21T07:48:53.737ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44852024-12-21T07:48:53.738ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5aa5526-a7cd-4ae9-a765-cb10bee83fea", "content-length": "26", "date": "Sat, 21 Dec 2024 07:48:53 GMT"} })
44862024-12-21T07:48:53.738ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44872024-12-21T07:48:53.740ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44882024-12-21T07:48:53.775ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 268.919813ms iteration = 4 status = {}
44892024-12-21T07:48:53.786ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44902024-12-21T07:48:53.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44912024-12-21T07:48:53.789ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
44922024-12-21T07:48:53.789ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
44932024-12-21T07:48:53.789ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44942024-12-21T07:48:53.789ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b5942f9-af97-4c6b-96fa-728bdee4688b", "content-length": "372", "date": "Sat, 21 Dec 2024 07:48:53 GMT"} })
44952024-12-21T07:48:53.789ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44962024-12-21T07:48:53.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44972024-12-21T07:48:53.791ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
44982024-12-21T07:48:53.791ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44992024-12-21T07:48:53.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45002024-12-21T07:48:53.793ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45012024-12-21T07:48:53.795ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45022024-12-21T07:48:53.795ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45032024-12-21T07:48:53.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45042024-12-21T07:48:53.811ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
45052024-12-21T07:48:53.811ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
45062024-12-21T07:48:53.811ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5d9f40e5-f924-4004-9dd7-3073b9bc2087", "date": "Sat, 21 Dec 2024 07:48:53 GMT"} })
45072024-12-21T07:48:53.811ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45082024-12-21T07:48:53.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45092024-12-21T07:48:53.814ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45102024-12-21T07:48:53.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45112024-12-21T07:48:53.817ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
45122024-12-21T07:48:53.817ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "129d13ec-23cd-4d87-ac81-775ed6ca9dd2", "content-length": "1", "date": "Sat, 21 Dec 2024 07:48:53 GMT"} })
45132024-12-21T07:48:53.818ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45142024-12-21T07:48:53.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45152024-12-21T07:48:53.818ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
45162024-12-21T07:48:53.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
45172024-12-21T07:48:53.821ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 315.336659ms iteration = 4 status = null
45182024-12-21T07:48:53.821ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
45192024-12-21T07:48:53.821ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45202024-12-21T07:48:53.822ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f65adec9-8f17-4c41-98a8-06e0aff5e2dd", "date": "Sat, 21 Dec 2024 07:48:53 GMT"} })
45212024-12-21T07:48:53.823ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 317.407344ms iteration = 5 status = {}
45222024-12-21T07:48:53.869ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45232024-12-21T07:48:53.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45242024-12-21T07:48:53.896ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
45252024-12-21T07:48:53.897ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "78dcd50a-0892-40ab-9a01-b80119400dca", "content-length": "691", "date": "Sat, 21 Dec 2024 07:48:53 GMT"} })
45262024-12-21T07:48:53.897ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
45272024-12-21T07:48:53.897ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
45282024-12-21T07:48:53.897ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
45292024-12-21T07:48:53.898ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 391.926462ms iteration = 4 status = {}
45302024-12-21T07:48:53.899ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
45312024-12-21T07:48:53.899ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45322024-12-21T07:48:53.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45332024-12-21T07:48:54.128ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
45342024-12-21T07:48:54.129ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8276cd07-b846-4c8a-993f-ec34aab529a5", "content-length": "134", "date": "Sat, 21 Dec 2024 07:48:53 GMT"} })
45352024-12-21T07:48:54.129ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
45362024-12-21T07:48:54.129ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
45372024-12-21T07:48:54.129ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
45382024-12-21T07:48:54.129ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
45392024-12-21T07:48:54.129ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45402024-12-21T07:48:54.129ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45412024-12-21T07:48:54.129ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45422024-12-21T07:48:54.129ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
45432024-12-21T07:48:54.129ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45442024-12-21T07:48:54.129ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
45452024-12-21T07:48:54.129ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
45462024-12-21T07:48:54.129ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45472024-12-21T07:48:54.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45482024-12-21T07:48:54.132ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
45492024-12-21T07:48:54.132ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8125596-8588-4f08-8c56-d54ba2c297aa", "content-length": "2", "date": "Sat, 21 Dec 2024 07:48:53 GMT"} })
45502024-12-21T07:48:54.132ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
45512024-12-21T07:48:54.132ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f721c83-76c9-4a18-94bd-ad4c03bdef6b", "content-length": "52", "date": "Sat, 21 Dec 2024 07:48:53 GMT"} })
45522024-12-21T07:48:54.132ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
45532024-12-21T07:48:54.132ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
45542024-12-21T07:48:54.265ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5c57ac65-b159-4671-aa38-6fe77b46dbc8", "date": "Sat, 21 Dec 2024 07:48:54 GMT"} })
45552024-12-21T07:48:54.265ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
45562024-12-21T07:48:54.265ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
45572024-12-21T07:48:54.269ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "86c25222-10c7-4d1d-96eb-135529f0dc3c", "content-length": "682", "date": "Sat, 21 Dec 2024 07:48:54 GMT"} })
45582024-12-21T07:48:54.269ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45592024-12-21T07:48:54.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45602024-12-21T07:48:54.272ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45612024-12-21T07:48:54.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45622024-12-21T07:48:54.276ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45632024-12-21T07:48:54.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45642024-12-21T07:48:54.279ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45652024-12-21T07:48:54.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45662024-12-21T07:48:54.285ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 779.48597ms iteration = 4 status = {}
45672024-12-21T07:48:54.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = cbfbf037-886a-4fdc-972d-dd79e2aa676f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
45682024-12-21T07:48:54.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = cbfbf037-886a-4fdc-972d-dd79e2aa676f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
45692024-12-21T07:48:54.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3851 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = cbfbf037-886a-4fdc-972d-dd79e2aa676f response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
45702024-12-21T07:48:55.896ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1187 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = a5cdad9c-7946-4ca3-88aa-3868010be7ed response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
45712024-12-21T07:49:03.505ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
45722024-12-21T07:49:03.505ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
45732024-12-21T07:49:03.505ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45742024-12-21T07:49:03.505ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45752024-12-21T07:49:03.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45762024-12-21T07:49:03.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45772024-12-21T07:49:03.507ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45782024-12-21T07:49:03.508ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45792024-12-21T07:49:03.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45802024-12-21T07:49:03.510ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45812024-12-21T07:49:03.510ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45822024-12-21T07:49:03.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45832024-12-21T07:49:03.511ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45842024-12-21T07:49:03.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45852024-12-21T07:49:03.513ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45862024-12-21T07:49:03.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
45872024-12-21T07:49:03.516ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45882024-12-21T07:49:03.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45892024-12-21T07:49:03.530ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
45902024-12-21T07:49:03.530ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.888127ms iteration = 11 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
45912024-12-21T07:49:03.542ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.527017ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45922024-12-21T07:49:05.896ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1325 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = a1586ada-3d3c-42a5-a5cf-fb2c41c8d0c4 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
45932024-12-21T07:49:13.505ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
45942024-12-21T07:49:13.505ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
45952024-12-21T07:49:13.505ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45962024-12-21T07:49:13.505ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45972024-12-21T07:49:13.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45982024-12-21T07:49:13.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45992024-12-21T07:49:13.507ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46002024-12-21T07:49:13.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46012024-12-21T07:49:13.508ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46022024-12-21T07:49:13.510ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46032024-12-21T07:49:13.510ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46042024-12-21T07:49:13.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46052024-12-21T07:49:13.513ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46062024-12-21T07:49:13.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46072024-12-21T07:49:13.515ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46082024-12-21T07:49:13.517ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
46092024-12-21T07:49:13.517ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46102024-12-21T07:49:13.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46112024-12-21T07:49:13.537ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.771945ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46122024-12-21T07:49:13.733ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
46132024-12-21T07:49:13.733ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 227.436612ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
46142024-12-21T07:49:15.896ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1202 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = b9d4586e-3fbc-402e-82e0-60325b6b8f14 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
46152024-12-21T07:49:20.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = aac5f745-8263-43be-b2d6-9e3842932213 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
46162024-12-21T07:49:20.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = aac5f745-8263-43be-b2d6-9e3842932213 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
46172024-12-21T07:49:20.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3116 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = aac5f745-8263-43be-b2d6-9e3842932213 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
46182024-12-21T07:49:20.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 0f163eb7-a7e5-4437-bb56-bdf6b0a51ab8 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
46192024-12-21T07:49:20.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 0f163eb7-a7e5-4437-bb56-bdf6b0a51ab8 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
46202024-12-21T07:49:20.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3060 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 0f163eb7-a7e5-4437-bb56-bdf6b0a51ab8 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
46212024-12-21T07:49:23.504ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
46222024-12-21T07:49:23.504ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
46232024-12-21T07:49:23.504ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46242024-12-21T07:49:23.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46252024-12-21T07:49:23.505ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
46262024-12-21T07:49:23.505ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
46272024-12-21T07:49:23.505ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
46282024-12-21T07:49:23.505ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
46292024-12-21T07:49:23.505ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46302024-12-21T07:49:23.505ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 3 reason = Timeout
46312024-12-21T07:49:23.505ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
46322024-12-21T07:49:23.505ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
46332024-12-21T07:49:23.505ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
46342024-12-21T07:49:23.505ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46352024-12-21T07:49:23.505ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
46362024-12-21T07:49:23.505ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46372024-12-21T07:49:23.505ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
46382024-12-21T07:49:23.505ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46392024-12-21T07:49:23.505ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
46402024-12-21T07:49:23.505ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
46412024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
46422024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
46432024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
46442024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46452024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
46462024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
46472024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
46482024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
46492024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
46502024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46512024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
46522024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
46532024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
46542024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
46552024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
46562024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
46572024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
46582024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46592024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
46602024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46612024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
46622024-12-21T07:49:23.506ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
46632024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46642024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
46652024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
46662024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46672024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
46682024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
46692024-12-21T07:49:23.506ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 3f45718f-9869-448a-a087-788e66db5e9d
46702024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46712024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
46722024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.88\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"3f45718f-9869-448a-a087-788e66db5e9d"}
46732024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
46742024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
46752024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46762024-12-21T07:49:23.506ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:39:23.506185832 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
46772024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
46782024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46792024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
46802024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
46812024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
46822024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
46832024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
46842024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
46852024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
46862024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
46872024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46882024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
46892024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46902024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46912024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46922024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
46932024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
46942024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46952024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46962024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
46972024-12-21T07:49:23.506ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1595c632-cfae-4f6b-937d-d413dd8cf0b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1083, tv_nsec: 458726181 } })
46982024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46992024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
47002024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
47012024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47022024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47032024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
47042024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47052024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47062024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
47072024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
47082024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
47092024-12-21T07:49:23.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47102024-12-21T07:49:23.506ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("481de7e8-0737-474b-8c33-e6e8bc6477be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("683a9892-43cd-4dd8-a983-26cccd988df0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1083, tv_nsec: 458869114 } })
47112024-12-21T07:49:23.507ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
47122024-12-21T07:49:23.507ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.14586ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
47132024-12-21T07:49:23.507ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
47142024-12-21T07:49:23.507ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.172189ms iteration = 4 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
47152024-12-21T07:49:23.509ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47162024-12-21T07:49:23.510ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.563318ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
47172024-12-21T07:49:23.511ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47182024-12-21T07:49:23.512ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47192024-12-21T07:49:23.513ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47202024-12-21T07:49:23.514ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
47212024-12-21T07:49:23.514ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47222024-12-21T07:49:23.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47232024-12-21T07:49:23.515ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
47242024-12-21T07:49:23.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
47252024-12-21T07:49:23.516ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
47262024-12-21T07:49:23.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
47272024-12-21T07:49:23.517ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
47282024-12-21T07:49:23.517ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47292024-12-21T07:49:23.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47302024-12-21T07:49:23.520ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
47312024-12-21T07:49:23.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47322024-12-21T07:49:23.523ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1083, tv_nsec: 475903976 } })
47332024-12-21T07:49:23.524ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
47342024-12-21T07:49:23.528ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1083, tv_nsec: 480531155 } })
47352024-12-21T07:49:23.528ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
47362024-12-21T07:49:23.540ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:39:23.506185832 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
47372024-12-21T07:49:23.540ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 34.160196ms iteration = 3 status = {"expiration":"2024-12-21T07:39:23.506185832Z","pruned":[]}
47382024-12-21T07:49:23.540ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 34.186447ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
47392024-12-21T07:49:23.545ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47402024-12-21T07:49:23.546ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47412024-12-21T07:49:23.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
47422024-12-21T07:49:23.549ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
47432024-12-21T07:49:23.549ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47442024-12-21T07:49:23.549ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47452024-12-21T07:49:23.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
47462024-12-21T07:49:23.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47472024-12-21T07:49:23.552ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47482024-12-21T07:49:23.552ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1083, tv_nsec: 504442846 } })
47492024-12-21T07:49:23.552ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
47502024-12-21T07:49:23.553ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47512024-12-21T07:49:23.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47522024-12-21T07:49:23.556ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
47532024-12-21T07:49:23.558ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 52.124515ms iteration = 5 status = {"errors":[],"finish_invoked_ok":[]}
47542024-12-21T07:49:23.563ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
47552024-12-21T07:49:23.563ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 56.938706ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
47562024-12-21T07:49:23.587ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47572024-12-21T07:49:23.587ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47582024-12-21T07:49:23.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47592024-12-21T07:49:23.589ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
47602024-12-21T07:49:23.589ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47612024-12-21T07:49:23.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47622024-12-21T07:49:23.592ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 86.380122ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47632024-12-21T07:49:23.594ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
47642024-12-21T07:49:23.594ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47652024-12-21T07:49:23.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
47662024-12-21T07:49:23.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47672024-12-21T07:49:23.596ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
47682024-12-21T07:49:23.596ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
47692024-12-21T07:49:23.596ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
47702024-12-21T07:49:23.596ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47712024-12-21T07:49:23.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47722024-12-21T07:49:23.599ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47732024-12-21T07:49:23.600ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47742024-12-21T07:49:23.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47752024-12-21T07:49:23.602ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47762024-12-21T07:49:23.602ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
47772024-12-21T07:49:23.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47782024-12-21T07:49:23.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47792024-12-21T07:49:23.603ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
47802024-12-21T07:49:23.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
47812024-12-21T07:49:23.604ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
47822024-12-21T07:49:23.604ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
47832024-12-21T07:49:23.604ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 98.135853ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
47842024-12-21T07:49:23.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
47852024-12-21T07:49:23.604ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47862024-12-21T07:49:23.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47872024-12-21T07:49:23.605ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47882024-12-21T07:49:23.605ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 99.330573ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
47892024-12-21T07:49:23.608ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
47902024-12-21T07:49:23.608ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
47912024-12-21T07:49:23.608ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 102.733342ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
47922024-12-21T07:49:23.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47932024-12-21T07:49:23.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
47942024-12-21T07:49:23.609ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47952024-12-21T07:49:23.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47962024-12-21T07:49:23.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47972024-12-21T07:49:23.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47982024-12-21T07:49:23.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47992024-12-21T07:49:23.613ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 107.663617ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
48002024-12-21T07:49:23.616ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48012024-12-21T07:49:23.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48022024-12-21T07:49:23.617ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48032024-12-21T07:49:23.617ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
48042024-12-21T07:49:23.617ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
48052024-12-21T07:49:23.617ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
48062024-12-21T07:49:23.617ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48072024-12-21T07:49:23.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48082024-12-21T07:49:23.618ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48092024-12-21T07:49:23.620ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
48102024-12-21T07:49:23.620ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48112024-12-21T07:49:23.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48122024-12-21T07:49:23.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
48132024-12-21T07:49:23.623ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48142024-12-21T07:49:23.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48152024-12-21T07:49:23.625ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48162024-12-21T07:49:23.626ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48172024-12-21T07:49:23.629ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
48182024-12-21T07:49:23.630ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48192024-12-21T07:49:23.630ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
48202024-12-21T07:49:23.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48212024-12-21T07:49:23.630ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48222024-12-21T07:49:23.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48232024-12-21T07:49:23.634ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48242024-12-21T07:49:23.634ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
48252024-12-21T07:49:23.634ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 0 version = 2
48262024-12-21T07:49:23.634ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48272024-12-21T07:49:23.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48282024-12-21T07:49:23.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48292024-12-21T07:49:23.636ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48302024-12-21T07:49:23.637ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48312024-12-21T07:49:23.639ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
48322024-12-21T07:49:23.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
48332024-12-21T07:49:23.640ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48342024-12-21T07:49:23.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48352024-12-21T07:49:23.641ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
48362024-12-21T07:49:23.641ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48372024-12-21T07:49:23.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48382024-12-21T07:49:23.644ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 1 version = 2
48392024-12-21T07:49:23.644ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
48402024-12-21T07:49:23.644ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 07:47:25.290148 UTC dns_group = external generation = 2
48412024-12-21T07:49:23.644ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 138.693309ms iteration = 4 status = {"generation":2}
48422024-12-21T07:49:23.645ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
48432024-12-21T07:49:23.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
48442024-12-21T07:49:23.666ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
48452024-12-21T07:49:23.667ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
48462024-12-21T07:49:23.667ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
48472024-12-21T07:49:23.667ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48482024-12-21T07:49:23.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48492024-12-21T07:49:23.670ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48502024-12-21T07:49:23.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48512024-12-21T07:49:23.672ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48522024-12-21T07:49:23.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
48532024-12-21T07:49:23.678ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48542024-12-21T07:49:23.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48552024-12-21T07:49:23.681ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
48562024-12-21T07:49:23.681ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48572024-12-21T07:49:23.681ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
48582024-12-21T07:49:23.681ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
48592024-12-21T07:49:23.681ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 07:47:23.936594 UTC dns_group = internal generation = 1
48602024-12-21T07:49:23.681ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 177.147619ms iteration = 4 status = {"generation":1}
48612024-12-21T07:49:23.682ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c93cc376-3c59-4252-9149-9435318f9a23", "content-length": "26", "date": "Sat, 21 Dec 2024 07:49:23 GMT"} })
48622024-12-21T07:49:23.682ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48632024-12-21T07:49:23.684ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48642024-12-21T07:49:23.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
48652024-12-21T07:49:23.685ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
48662024-12-21T07:49:23.686ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 180.134549ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
48672024-12-21T07:49:23.688ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48682024-12-21T07:49:23.691ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
48692024-12-21T07:49:23.691ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48702024-12-21T07:49:23.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
48712024-12-21T07:49:23.698ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48722024-12-21T07:49:23.699ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
48732024-12-21T07:49:23.699ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48742024-12-21T07:49:23.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48752024-12-21T07:49:23.704ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
48762024-12-21T07:49:23.704ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48772024-12-21T07:49:23.705ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48782024-12-21T07:49:23.705ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe20cd45-9bef-4cc8-90f3-18911c10df7f", "content-length": "26", "date": "Sat, 21 Dec 2024 07:49:23 GMT"} })
48792024-12-21T07:49:23.705ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48802024-12-21T07:49:23.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48812024-12-21T07:49:23.709ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
48822024-12-21T07:49:23.709ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48832024-12-21T07:49:23.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48842024-12-21T07:49:23.710ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48852024-12-21T07:49:23.714ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
48862024-12-21T07:49:23.714ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48872024-12-21T07:49:23.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48882024-12-21T07:49:23.716ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 210.279207ms iteration = 5 status = 0
48892024-12-21T07:49:23.722ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 215.872053ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
48902024-12-21T07:49:23.728ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48912024-12-21T07:49:23.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48922024-12-21T07:49:23.744ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
48932024-12-21T07:49:23.744ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48942024-12-21T07:49:23.745ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3604924e-2649-40b0-bbde-f540d3ad5e04", "content-length": "26", "date": "Sat, 21 Dec 2024 07:49:23 GMT"} })
48952024-12-21T07:49:23.745ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48962024-12-21T07:49:23.746ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
48972024-12-21T07:49:23.750ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48982024-12-21T07:49:23.750ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
48992024-12-21T07:49:23.750ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 244.724248ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
49002024-12-21T07:49:23.754ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:47:21.583817Z, time_modified: 2024-12-21T07:47:21.583817Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
49012024-12-21T07:49:23.754ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 248.204597ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]}},"default_endpoint":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
49022024-12-21T07:49:23.795ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
49032024-12-21T07:49:23.795ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 289.451294ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
49042024-12-21T07:49:23.800ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 294.646773ms iteration = 7 status = {"physical_disks_added":0}
49052024-12-21T07:49:23.818ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
49062024-12-21T07:49:23.818ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "66517ab0-1d20-4378-b241-b8328ab40d89", "date": "Sat, 21 Dec 2024 07:49:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
49072024-12-21T07:49:23.818ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
49082024-12-21T07:49:23.819ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "c7f0d623-9bf5-4798-afc3-7f5185a54950", "date": "Sat, 21 Dec 2024 07:49:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
49092024-12-21T07:49:23.819ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
49102024-12-21T07:49:23.821ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
49112024-12-21T07:49:23.821ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 315.788615ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
49122024-12-21T07:49:23.832ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
49132024-12-21T07:49:23.832ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8db2d37f-b2e6-4753-8af4-ae87b47b5b82", "content-length": "1", "date": "Sat, 21 Dec 2024 07:49:23 GMT"} })
49142024-12-21T07:49:23.834ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
49152024-12-21T07:49:23.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
49162024-12-21T07:49:23.837ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 331.099779ms iteration = 5 status = null
49172024-12-21T07:49:23.838ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
49182024-12-21T07:49:23.844ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49192024-12-21T07:49:23.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49202024-12-21T07:49:23.846ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49212024-12-21T07:49:23.848ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
49222024-12-21T07:49:23.848ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49232024-12-21T07:49:23.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49242024-12-21T07:49:23.850ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49252024-12-21T07:49:23.852ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
49262024-12-21T07:49:23.852ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49272024-12-21T07:49:23.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49282024-12-21T07:49:23.854ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
49292024-12-21T07:49:23.854ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 348.518507ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
49302024-12-21T07:49:23.886ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
49312024-12-21T07:49:23.886ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49322024-12-21T07:49:23.886ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 380.541317ms iteration = 5 status = {}
49332024-12-21T07:49:23.886ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8af9ad26-016c-4831-897e-ee21b8768589", "content-length": "372", "date": "Sat, 21 Dec 2024 07:49:23 GMT"} })
49342024-12-21T07:49:23.886ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49352024-12-21T07:49:23.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49362024-12-21T07:49:23.901ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
49372024-12-21T07:49:23.901ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
49382024-12-21T07:49:23.902ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6539bcd5-8ef1-488a-89c3-1b68a50ae8b9", "date": "Sat, 21 Dec 2024 07:49:23 GMT"} })
49392024-12-21T07:49:23.902ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49402024-12-21T07:49:23.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49412024-12-21T07:49:23.904ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49422024-12-21T07:49:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49432024-12-21T07:49:23.935ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
49442024-12-21T07:49:23.936ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "cb7fd0e3-f006-4d5b-9f93-104f727b5134", "date": "Sat, 21 Dec 2024 07:49:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
49452024-12-21T07:49:23.936ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
49462024-12-21T07:49:23.937ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "67f27e8d-b292-4a70-9d1b-bdcafd6b82e8", "date": "Sat, 21 Dec 2024 07:49:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
49472024-12-21T07:49:23.937ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
49482024-12-21T07:49:23.939ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "f7a6a55a-f5d5-4c56-b303-eab2b1880452", "date": "Sat, 21 Dec 2024 07:49:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
49492024-12-21T07:49:23.939ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
49502024-12-21T07:49:23.941ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
49512024-12-21T07:49:23.941ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 435.127313ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
49522024-12-21T07:49:23.942ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
49532024-12-21T07:49:23.942ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e486d243-16d8-4c92-96d7-34270778d1f0", "content-length": "691", "date": "Sat, 21 Dec 2024 07:49:23 GMT"} })
49542024-12-21T07:49:23.942ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
49552024-12-21T07:49:23.942ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
49562024-12-21T07:49:23.942ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
49572024-12-21T07:49:23.945ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 439.01991ms iteration = 5 status = {}
49582024-12-21T07:49:23.953ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49592024-12-21T07:49:23.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49602024-12-21T07:49:23.957ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
49612024-12-21T07:49:23.957ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49622024-12-21T07:49:23.957ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "16ab63c7-5f1a-402e-b5b9-07ae8cc9ff22", "date": "Sat, 21 Dec 2024 07:49:23 GMT"} })
49632024-12-21T07:49:23.958ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 452.848716ms iteration = 6 status = {}
49642024-12-21T07:49:23.989ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49652024-12-21T07:49:23.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49662024-12-21T07:49:24.091ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
49672024-12-21T07:49:24.091ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49682024-12-21T07:49:24.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49692024-12-21T07:49:24.194ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
49702024-12-21T07:49:24.195ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e8fe81b-4135-4e7b-8f8e-90b50a7a54bd", "content-length": "134", "date": "Sat, 21 Dec 2024 07:49:24 GMT"} })
49712024-12-21T07:49:24.195ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
49722024-12-21T07:49:24.195ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
49732024-12-21T07:49:24.195ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
49742024-12-21T07:49:24.195ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
49752024-12-21T07:49:24.195ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49762024-12-21T07:49:24.195ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49772024-12-21T07:49:24.195ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49782024-12-21T07:49:24.195ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
49792024-12-21T07:49:24.195ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49802024-12-21T07:49:24.195ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
49812024-12-21T07:49:24.195ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
49822024-12-21T07:49:24.195ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49832024-12-21T07:49:24.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49842024-12-21T07:49:24.198ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
49852024-12-21T07:49:24.198ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "43b3578b-0ce1-49f8-a928-f3d70f3c6d2d", "content-length": "2", "date": "Sat, 21 Dec 2024 07:49:24 GMT"} })
49862024-12-21T07:49:24.198ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
49872024-12-21T07:49:24.198ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "83074747-a490-4d07-ae1e-0b01fc67be8f", "content-length": "52", "date": "Sat, 21 Dec 2024 07:49:24 GMT"} })
49882024-12-21T07:49:24.198ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
49892024-12-21T07:49:24.198ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
49902024-12-21T07:49:24.297ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7600fd09-a571-4a4e-8206-f5b6b25eeb20", "date": "Sat, 21 Dec 2024 07:49:24 GMT"} })
49912024-12-21T07:49:24.297ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
49922024-12-21T07:49:24.297ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
49932024-12-21T07:49:24.301ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "de3b6bce-7c4e-4d1f-8d8e-14f1ac2ad019", "content-length": "682", "date": "Sat, 21 Dec 2024 07:49:23 GMT"} })
49942024-12-21T07:49:24.301ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49952024-12-21T07:49:24.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49962024-12-21T07:49:24.305ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49972024-12-21T07:49:24.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49982024-12-21T07:49:24.309ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49992024-12-21T07:49:24.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50002024-12-21T07:49:24.311ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50012024-12-21T07:49:24.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50022024-12-21T07:49:24.317ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 811.62964ms iteration = 5 status = {}
50032024-12-21T07:49:24.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 64b4b060-d07b-4aa7-9ca6-10146b5c881a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
50042024-12-21T07:49:24.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 64b4b060-d07b-4aa7-9ca6-10146b5c881a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
50052024-12-21T07:49:24.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2649 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 64b4b060-d07b-4aa7-9ca6-10146b5c881a response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
50062024-12-21T07:49:25.896ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1128 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 1f1f0ca9-2cbc-4af5-91d5-d5ccf47df51e response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
50072024-12-21T07:49:33.505ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
50082024-12-21T07:49:33.505ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
50092024-12-21T07:49:33.505ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50102024-12-21T07:49:33.505ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50112024-12-21T07:49:33.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50122024-12-21T07:49:33.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50132024-12-21T07:49:33.507ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50142024-12-21T07:49:33.508ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50152024-12-21T07:49:33.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50162024-12-21T07:49:33.510ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50172024-12-21T07:49:33.510ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50182024-12-21T07:49:33.510ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.298874ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50192024-12-21T07:49:33.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50202024-12-21T07:49:33.512ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50212024-12-21T07:49:33.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50222024-12-21T07:49:33.513ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50232024-12-21T07:49:33.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
50242024-12-21T07:49:33.516ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50252024-12-21T07:49:33.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50262024-12-21T07:49:33.524ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
50272024-12-21T07:49:33.524ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.240693ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
50282024-12-21T07:49:35.896ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1185 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 4afb34d6-cba0-48d5-a7e4-6ef17b14d9de response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
50292024-12-21T07:49:43.506ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
50302024-12-21T07:49:43.506ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
50312024-12-21T07:49:43.506ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50322024-12-21T07:49:43.506ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50332024-12-21T07:49:43.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50342024-12-21T07:49:43.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50352024-12-21T07:49:43.508ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50362024-12-21T07:49:43.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50372024-12-21T07:49:43.508ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50382024-12-21T07:49:43.510ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.584449ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50392024-12-21T07:49:43.511ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50402024-12-21T07:49:43.511ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50412024-12-21T07:49:43.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50422024-12-21T07:49:43.513ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50432024-12-21T07:49:43.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50442024-12-21T07:49:43.514ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50452024-12-21T07:49:43.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
50462024-12-21T07:49:43.516ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50472024-12-21T07:49:43.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50482024-12-21T07:49:43.630ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
50492024-12-21T07:49:43.630ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 124.414254ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
50502024-12-21T07:49:45.896ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1251 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = bdd84d4c-5816-4a45-9c25-a5be0fb7c695 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
50512024-12-21T07:49:50.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = accfc617-14a6-42b7-add3-cad0774a254e roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
50522024-12-21T07:49:50.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = accfc617-14a6-42b7-add3-cad0774a254e resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
50532024-12-21T07:49:50.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3496 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = accfc617-14a6-42b7-add3-cad0774a254e response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
50542024-12-21T07:49:50.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = b724eb73-2bdb-4ef7-a9fb-c58b31d0c447 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
50552024-12-21T07:49:50.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = b724eb73-2bdb-4ef7-a9fb-c58b31d0c447 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
50562024-12-21T07:49:50.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107074 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = b724eb73-2bdb-4ef7-a9fb-c58b31d0c447 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
50572024-12-21T07:49:53.506ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
50582024-12-21T07:49:53.506ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
50592024-12-21T07:49:53.506ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
50602024-12-21T07:49:53.506ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50612024-12-21T07:49:53.506ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
50622024-12-21T07:49:53.506ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50632024-12-21T07:49:53.506ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
50642024-12-21T07:49:53.506ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
50652024-12-21T07:49:53.506ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50662024-12-21T07:49:53.506ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
50672024-12-21T07:49:53.506ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
50682024-12-21T07:49:53.506ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50692024-12-21T07:49:53.506ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
50702024-12-21T07:49:53.506ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50712024-12-21T07:49:53.506ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
50722024-12-21T07:49:53.506ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50732024-12-21T07:49:53.506ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
50742024-12-21T07:49:53.506ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
50752024-12-21T07:49:53.506ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50762024-12-21T07:49:53.506ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
50772024-12-21T07:49:53.506ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
50782024-12-21T07:49:53.506ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
50792024-12-21T07:49:53.506ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
50802024-12-21T07:49:53.506ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
50812024-12-21T07:49:53.506ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50822024-12-21T07:49:53.506ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
50832024-12-21T07:49:53.506ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
50842024-12-21T07:49:53.506ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50852024-12-21T07:49:53.506ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
50862024-12-21T07:49:53.506ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50872024-12-21T07:49:53.506ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
50882024-12-21T07:49:53.506ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
50892024-12-21T07:49:53.506ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50902024-12-21T07:49:53.506ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
50912024-12-21T07:49:53.506ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50922024-12-21T07:49:53.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
50932024-12-21T07:49:53.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50942024-12-21T07:49:53.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
50952024-12-21T07:49:53.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50962024-12-21T07:49:53.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50972024-12-21T07:49:53.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
50982024-12-21T07:49:53.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50992024-12-21T07:49:53.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51002024-12-21T07:49:53.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
51012024-12-21T07:49:53.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
51022024-12-21T07:49:53.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51032024-12-21T07:49:53.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51042024-12-21T07:49:53.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
51052024-12-21T07:49:53.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
51062024-12-21T07:49:53.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51072024-12-21T07:49:53.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51082024-12-21T07:49:53.510ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51092024-12-21T07:49:53.511ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1113, tv_nsec: 462983954 } })
51102024-12-21T07:49:53.511ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
51112024-12-21T07:49:53.511ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51122024-12-21T07:49:53.512ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.037304ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
51132024-12-21T07:49:53.513ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.43804ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
51142024-12-21T07:49:53.514ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
51152024-12-21T07:49:53.514ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51162024-12-21T07:49:53.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51172024-12-21T07:49:53.514ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
51182024-12-21T07:49:53.514ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51192024-12-21T07:49:53.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51202024-12-21T07:49:53.516ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51212024-12-21T07:49:53.517ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51222024-12-21T07:49:53.519ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
51232024-12-21T07:49:53.519ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51242024-12-21T07:49:53.519ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
51252024-12-21T07:49:53.519ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
51262024-12-21T07:49:53.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51272024-12-21T07:49:53.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
51282024-12-21T07:49:53.522ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1113, tv_nsec: 473716158 } })
51292024-12-21T07:49:53.522ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
51302024-12-21T07:49:53.529ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51312024-12-21T07:49:53.530ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
51322024-12-21T07:49:53.530ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
51332024-12-21T07:49:53.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
51342024-12-21T07:49:53.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51352024-12-21T07:49:53.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
51362024-12-21T07:49:53.532ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51372024-12-21T07:49:53.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51382024-12-21T07:49:53.533ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51392024-12-21T07:49:53.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51402024-12-21T07:49:53.533ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
51412024-12-21T07:49:53.533ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51422024-12-21T07:49:53.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51432024-12-21T07:49:53.534ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1113, tv_nsec: 485851736 } })
51442024-12-21T07:49:53.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51452024-12-21T07:49:53.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51462024-12-21T07:49:53.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51472024-12-21T07:49:53.534ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
51482024-12-21T07:49:53.535ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 29.253871ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
51492024-12-21T07:49:53.536ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 29.882793ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
51502024-12-21T07:49:53.536ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51512024-12-21T07:49:53.537ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51522024-12-21T07:49:53.540ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
51532024-12-21T07:49:53.540ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51542024-12-21T07:49:53.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51552024-12-21T07:49:53.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
51562024-12-21T07:49:53.540ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51572024-12-21T07:49:53.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51582024-12-21T07:49:53.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51592024-12-21T07:49:53.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51602024-12-21T07:49:53.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51612024-12-21T07:49:53.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
51622024-12-21T07:49:53.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51632024-12-21T07:49:53.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51642024-12-21T07:49:53.550ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51652024-12-21T07:49:53.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51662024-12-21T07:49:53.553ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 46.945685ms iteration = 6 status = {"errors":[],"finish_invoked_ok":[]}
51672024-12-21T07:49:53.557ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51682024-12-21T07:49:53.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51692024-12-21T07:49:53.558ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51702024-12-21T07:49:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51712024-12-21T07:49:53.560ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 53.799572ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
51722024-12-21T07:49:53.562ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
51732024-12-21T07:49:53.562ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 55.694665ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
51742024-12-21T07:49:53.578ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
51752024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 72.3256ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
51762024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51772024-12-21T07:49:53.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51782024-12-21T07:49:53.585ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 79.425242ms iteration = 8 status = {"physical_disks_added":0}
51792024-12-21T07:49:53.588ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 81.691232ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51802024-12-21T07:49:53.598ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51812024-12-21T07:49:53.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51822024-12-21T07:49:53.600ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51832024-12-21T07:49:53.602ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51842024-12-21T07:49:53.602ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51852024-12-21T07:49:53.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51862024-12-21T07:49:53.604ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51872024-12-21T07:49:53.605ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
51882024-12-21T07:49:53.605ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51892024-12-21T07:49:53.605ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "09f429cf-5853-465e-a19c-3385d3e20601", "content-length": "26", "date": "Sat, 21 Dec 2024 07:49:53 GMT"} })
51902024-12-21T07:49:53.605ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51912024-12-21T07:49:53.606ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51922024-12-21T07:49:53.606ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51932024-12-21T07:49:53.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51942024-12-21T07:49:53.608ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
51952024-12-21T07:49:53.609ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
51962024-12-21T07:49:53.609ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51972024-12-21T07:49:53.609ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c9f7660-763a-455c-9c57-197a0b9f344f", "content-length": "26", "date": "Sat, 21 Dec 2024 07:49:53 GMT"} })
51982024-12-21T07:49:53.609ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51992024-12-21T07:49:53.612ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
52002024-12-21T07:49:53.613ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
52012024-12-21T07:49:53.613ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52022024-12-21T07:49:53.613ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "907e265b-c110-4a8d-938a-8e9be4a21442", "content-length": "26", "date": "Sat, 21 Dec 2024 07:49:53 GMT"} })
52032024-12-21T07:49:53.613ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52042024-12-21T07:49:53.615ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
52052024-12-21T07:49:53.617ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52062024-12-21T07:49:53.617ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
52072024-12-21T07:49:53.617ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52082024-12-21T07:49:53.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52092024-12-21T07:49:53.647ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52102024-12-21T07:49:53.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52112024-12-21T07:49:53.721ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52122024-12-21T07:49:53.721ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
52132024-12-21T07:49:53.721ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52142024-12-21T07:49:53.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52152024-12-21T07:49:53.726ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
52162024-12-21T07:49:53.726ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6f24865-7a73-4010-97e5-b42409d20af7", "content-length": "1", "date": "Sat, 21 Dec 2024 07:49:52 GMT"} })
52172024-12-21T07:49:53.728ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
52182024-12-21T07:49:53.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
52192024-12-21T07:49:53.754ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
52202024-12-21T07:49:53.754ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
52212024-12-21T07:49:53.754ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee49da06-2614-4d6f-93b5-3e9a644444b5", "content-length": "372", "date": "Sat, 21 Dec 2024 07:49:53 GMT"} })
52222024-12-21T07:49:53.754ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52232024-12-21T07:49:53.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52242024-12-21T07:49:53.757ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 250.647029ms iteration = 6 status = null
52252024-12-21T07:49:53.757ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52262024-12-21T07:49:53.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52272024-12-21T07:49:53.760ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52282024-12-21T07:49:53.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
52292024-12-21T07:49:53.763ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52302024-12-21T07:49:53.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52312024-12-21T07:49:53.765ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 258.525115ms iteration = 6 status = 0
52322024-12-21T07:49:53.771ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
52332024-12-21T07:49:53.771ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
52342024-12-21T07:49:53.771ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f836c288-0310-4bb8-8ba7-127cc54674fc", "date": "Sat, 21 Dec 2024 07:49:53 GMT"} })
52352024-12-21T07:49:53.771ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52362024-12-21T07:49:53.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52372024-12-21T07:49:53.773ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52382024-12-21T07:49:53.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52392024-12-21T07:49:53.776ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52402024-12-21T07:49:53.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52412024-12-21T07:49:53.780ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
52422024-12-21T07:49:53.780ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
52432024-12-21T07:49:53.780ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4ecd87a4-0c39-47e6-a265-741132c0da55", "date": "Sat, 21 Dec 2024 07:49:53 GMT"} })
52442024-12-21T07:49:53.782ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 275.373963ms iteration = 7 status = {}
52452024-12-21T07:49:53.792ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52462024-12-21T07:49:53.792ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
52472024-12-21T07:49:53.792ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 285.67445ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
52482024-12-21T07:49:53.824ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 317.812451ms iteration = 6 status = {}
52492024-12-21T07:49:53.938ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
52502024-12-21T07:49:53.962ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "695e10c4-7967-4baf-831c-89aed7b586cf", "content-length": "691", "date": "Sat, 21 Dec 2024 07:49:53 GMT"} })
52512024-12-21T07:49:53.962ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
52522024-12-21T07:49:53.962ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
52532024-12-21T07:49:53.962ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
52542024-12-21T07:49:53.963ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 456.951068ms iteration = 6 status = {}
52552024-12-21T07:49:53.973ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52562024-12-21T07:49:53.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52572024-12-21T07:49:53.976ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
52582024-12-21T07:49:53.976ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52592024-12-21T07:49:53.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52602024-12-21T07:49:53.984ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
52612024-12-21T07:49:53.984ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0b25009-c087-4d58-8c68-45f283d7c88a", "content-length": "134", "date": "Sat, 21 Dec 2024 07:49:53 GMT"} })
52622024-12-21T07:49:53.984ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
52632024-12-21T07:49:53.984ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
52642024-12-21T07:49:53.985ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
52652024-12-21T07:49:53.985ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
52662024-12-21T07:49:53.985ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52672024-12-21T07:49:53.985ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52682024-12-21T07:49:53.985ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52692024-12-21T07:49:53.985ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
52702024-12-21T07:49:53.985ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52712024-12-21T07:49:53.985ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
52722024-12-21T07:49:53.985ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
52732024-12-21T07:49:53.985ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52742024-12-21T07:49:53.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52752024-12-21T07:49:53.988ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
52762024-12-21T07:49:53.988ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d11bdb94-4fa6-45a1-b060-bbb957680095", "content-length": "2", "date": "Sat, 21 Dec 2024 07:49:53 GMT"} })
52772024-12-21T07:49:53.988ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
52782024-12-21T07:49:53.988ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "093330f5-a10b-4b3d-9c50-55b72f8c127f", "content-length": "52", "date": "Sat, 21 Dec 2024 07:49:53 GMT"} })
52792024-12-21T07:49:53.988ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
52802024-12-21T07:49:53.988ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
52812024-12-21T07:49:54.146ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "010cc991-399c-44f6-a97f-6a542fabaa23", "date": "Sat, 21 Dec 2024 07:49:53 GMT"} })
52822024-12-21T07:49:54.146ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
52832024-12-21T07:49:54.146ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
52842024-12-21T07:49:54.146ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e08ad51-1d61-4aa9-8fbc-a39576580ed4", "content-length": "682", "date": "Sat, 21 Dec 2024 07:49:53 GMT"} })
52852024-12-21T07:49:54.146ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52862024-12-21T07:49:54.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52872024-12-21T07:49:54.151ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52882024-12-21T07:49:54.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52892024-12-21T07:49:54.154ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52902024-12-21T07:49:54.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52912024-12-21T07:49:54.156ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52922024-12-21T07:49:54.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52932024-12-21T07:49:54.164ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 657.547628ms iteration = 6 status = {}
52942024-12-21T07:49:54.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = fb77719a-c950-49c4-b7ba-0a7ad31eb7f9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
52952024-12-21T07:49:54.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = fb77719a-c950-49c4-b7ba-0a7ad31eb7f9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
52962024-12-21T07:49:54.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3160 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = fb77719a-c950-49c4-b7ba-0a7ad31eb7f9 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
52972024-12-21T07:49:55.896ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1325 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = ec67dfcb-ad9f-4d61-aa11-bc74b162306b response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
52982024-12-21T07:49:56.031ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:48866
52992024-12-21T07:49:56.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48866 req_id = 66267deb-9ecb-4f4d-ba13-009b156d9f33 roles = RoleSet { roles: {} } uri = /metrics/producers
53002024-12-21T07:49:56.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48866 req_id = 66267deb-9ecb-4f4d-ba13-009b156d9f33 resource = Database result = Ok(()) uri = /metrics/producers
53012024-12-21T07:49:56.103ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = b2e6180f-2896-4592-b155-f5ca3f904fa7
53022024-12-21T07:49:56.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71409 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48866 req_id = 66267deb-9ecb-4f4d-ba13-009b156d9f33 response_code = 201 uri = /metrics/producers
53032024-12-21T07:49:56.240ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
53042024-12-21T07:49:56.240ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
53052024-12-21T07:49:56.271ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
53062024-12-21T07:49:56.271ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:34661
53072024-12-21T07:49:56.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:34661 req_id = 67c15a3a-4b4f-43b6-a958-30ad3b180c03 roles = RoleSet { roles: {} } uri = /metrics/producers
53082024-12-21T07:49:56.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:34661 req_id = 67c15a3a-4b4f-43b6-a958-30ad3b180c03 resource = Database result = Ok(()) uri = /metrics/producers
53092024-12-21T07:49:56.306ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
53102024-12-21T07:49:56.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35009 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:34661 req_id = 67c15a3a-4b4f-43b6-a958-30ad3b180c03 response_code = 201 uri = /metrics/producers
53112024-12-21T07:49:56.306ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "67c15a3a-4b4f-43b6-a958-30ad3b180c03", "content-length": "41", "date": "Sat, 21 Dec 2024 07:49:56 GMT"} })
53122024-12-21T07:49:56.308ZDEBGnexus (producer-registration-task): registered with nexus successfully
53132024-12-21T07:49:56.309ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
53142024-12-21T07:50:03.506ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
53152024-12-21T07:50:03.506ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53162024-12-21T07:50:03.506ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
53172024-12-21T07:50:03.506ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53182024-12-21T07:50:03.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53192024-12-21T07:50:03.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53202024-12-21T07:50:03.508ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53212024-12-21T07:50:03.508ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53222024-12-21T07:50:03.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53232024-12-21T07:50:03.510ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53242024-12-21T07:50:03.510ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53252024-12-21T07:50:03.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53262024-12-21T07:50:03.512ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53272024-12-21T07:50:03.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53282024-12-21T07:50:03.514ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53292024-12-21T07:50:03.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
53302024-12-21T07:50:03.516ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53312024-12-21T07:50:03.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53322024-12-21T07:50:03.526ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
53332024-12-21T07:50:03.526ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.143946ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
53342024-12-21T07:50:03.542ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.369774ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53352024-12-21T07:50:05.896ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1144 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 382e490e-e012-420b-80f3-b6cc0b056fd3 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
53362024-12-21T07:50:10.852ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:52247
53372024-12-21T07:50:10.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52247 req_id = f46154bf-8a17-45cf-bf3e-944c4202112c roles = RoleSet { roles: {} } uri = /metrics/producers
53382024-12-21T07:50:10.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52247 req_id = f46154bf-8a17-45cf-bf3e-944c4202112c resource = Database result = Ok(()) uri = /metrics/producers
53392024-12-21T07:50:10.894ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = 42bd0fec-23e2-48f9-bdad-7989f94730a0
53402024-12-21T07:50:10.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41867 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52247 req_id = f46154bf-8a17-45cf-bf3e-944c4202112c response_code = 201 uri = /metrics/producers
53412024-12-21T07:50:13.506ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
53422024-12-21T07:50:13.506ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
53432024-12-21T07:50:13.506ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53442024-12-21T07:50:13.506ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53452024-12-21T07:50:13.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53462024-12-21T07:50:13.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53472024-12-21T07:50:13.508ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53482024-12-21T07:50:13.511ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53492024-12-21T07:50:13.511ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53502024-12-21T07:50:13.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53512024-12-21T07:50:13.513ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53522024-12-21T07:50:13.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53532024-12-21T07:50:13.514ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53542024-12-21T07:50:13.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
53552024-12-21T07:50:13.516ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53562024-12-21T07:50:13.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53572024-12-21T07:50:13.528ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
53582024-12-21T07:50:13.528ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.939586ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
53592024-12-21T07:50:13.537ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53602024-12-21T07:50:13.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53612024-12-21T07:50:13.539ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.439336ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53622024-12-21T07:50:15.548ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:46193
53632024-12-21T07:50:15.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46193 req_id = f296f8c2-a1ae-4642-a766-8585789d84ce roles = RoleSet { roles: {} } uri = /metrics/producers
53642024-12-21T07:50:15.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46193 req_id = f296f8c2-a1ae-4642-a766-8585789d84ce resource = Database result = Ok(()) uri = /metrics/producers
53652024-12-21T07:50:15.570ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = cae81b8e-6ade-45fa-953a-26f79465611b
53662024-12-21T07:50:15.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21703 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46193 req_id = f296f8c2-a1ae-4642-a766-8585789d84ce response_code = 201 uri = /metrics/producers
53672024-12-21T07:50:15.897ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1522 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 3357882f-291b-4d05-a7d4-2041eac755ab response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
53682024-12-21T07:50:20.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 39638625-d95d-4aef-a64e-3638cc3cf1fe roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
53692024-12-21T07:50:20.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 39638625-d95d-4aef-a64e-3638cc3cf1fe resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
53702024-12-21T07:50:20.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3568 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 39638625-d95d-4aef-a64e-3638cc3cf1fe response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
53712024-12-21T07:50:20.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 399cf747-9119-40b9-8f56-f3b7c133acca roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
53722024-12-21T07:50:20.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 399cf747-9119-40b9-8f56-f3b7c133acca resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
53732024-12-21T07:50:20.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2088 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 399cf747-9119-40b9-8f56-f3b7c133acca response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
53742024-12-21T07:50:23.505ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
53752024-12-21T07:50:23.505ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
53762024-12-21T07:50:23.505ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53772024-12-21T07:50:23.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53782024-12-21T07:50:23.506ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
53792024-12-21T07:50:23.506ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
53802024-12-21T07:50:23.506ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
53812024-12-21T07:50:23.506ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
53822024-12-21T07:50:23.506ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
53832024-12-21T07:50:23.506ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
53842024-12-21T07:50:23.506ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53852024-12-21T07:50:23.506ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
53862024-12-21T07:50:23.506ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
53872024-12-21T07:50:23.506ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53882024-12-21T07:50:23.506ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
53892024-12-21T07:50:23.506ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
53902024-12-21T07:50:23.506ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53912024-12-21T07:50:23.506ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
53922024-12-21T07:50:23.506ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
53932024-12-21T07:50:23.506ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 3f45718f-9869-448a-a087-788e66db5e9d
53942024-12-21T07:50:23.506ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53952024-12-21T07:50:23.506ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
53962024-12-21T07:50:23.506ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 23.901\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"3f45718f-9869-448a-a087-788e66db5e9d"}
53972024-12-21T07:50:23.506ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
53982024-12-21T07:50:23.506ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
53992024-12-21T07:50:23.506ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54002024-12-21T07:50:23.506ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54012024-12-21T07:50:23.506ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
54022024-12-21T07:50:23.506ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54032024-12-21T07:50:23.506ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
54042024-12-21T07:50:23.506ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
54052024-12-21T07:50:23.506ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:40:23.506834492 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
54062024-12-21T07:50:23.506ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
54072024-12-21T07:50:23.506ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
54082024-12-21T07:50:23.506ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54092024-12-21T07:50:23.506ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
54102024-12-21T07:50:23.506ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
54112024-12-21T07:50:23.506ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
54122024-12-21T07:50:23.506ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
54132024-12-21T07:50:23.506ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
54142024-12-21T07:50:23.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
54152024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54162024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
54172024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
54182024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
54192024-12-21T07:50:23.507ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
54202024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54212024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
54222024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
54232024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54242024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
54252024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
54262024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
54272024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
54282024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54292024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
54302024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54312024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
54322024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54332024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
54342024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
54352024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
54362024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
54372024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
54382024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
54392024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54402024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
54412024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
54422024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54432024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54442024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
54452024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54462024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54472024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54482024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
54492024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54502024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54512024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54522024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54532024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
54542024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54552024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54562024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
54572024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
54582024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
54592024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54602024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54612024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54622024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54632024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54642024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54652024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
54662024-12-21T07:50:23.507ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("481de7e8-0737-474b-8c33-e6e8bc6477be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("683a9892-43cd-4dd8-a983-26cccd988df0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1143, tv_nsec: 459175909 } })
54672024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54682024-12-21T07:50:23.507ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54692024-12-21T07:50:23.507ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1595c632-cfae-4f6b-937d-d413dd8cf0b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1143, tv_nsec: 459212899 } })
54702024-12-21T07:50:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54712024-12-21T07:50:23.508ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54722024-12-21T07:50:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54732024-12-21T07:50:23.508ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54742024-12-21T07:50:23.508ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
54752024-12-21T07:50:23.508ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.364343ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
54762024-12-21T07:50:23.508ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
54772024-12-21T07:50:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54782024-12-21T07:50:23.508ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.420425ms iteration = 5 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
54792024-12-21T07:50:23.509ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.996831ms iteration = 7 status = {"errors":[],"finish_invoked_ok":[]}
54802024-12-21T07:50:23.510ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54812024-12-21T07:50:23.512ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54822024-12-21T07:50:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54832024-12-21T07:50:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
54842024-12-21T07:50:23.512ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
54852024-12-21T07:50:23.513ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.87918ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
54862024-12-21T07:50:23.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
54872024-12-21T07:50:23.513ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54882024-12-21T07:50:23.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54892024-12-21T07:50:23.514ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
54902024-12-21T07:50:23.514ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
54912024-12-21T07:50:23.514ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 8.079349ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
54922024-12-21T07:50:23.515ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54932024-12-21T07:50:23.516ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54942024-12-21T07:50:23.516ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54952024-12-21T07:50:23.516ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:40:23.506834492 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
54962024-12-21T07:50:23.516ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.671216ms iteration = 4 status = {"expiration":"2024-12-21T07:40:23.506834492Z","pruned":[]}
54972024-12-21T07:50:23.519ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
54982024-12-21T07:50:23.519ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54992024-12-21T07:50:23.519ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55002024-12-21T07:50:23.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55012024-12-21T07:50:23.520ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
55022024-12-21T07:50:23.520ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
55032024-12-21T07:50:23.520ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
55042024-12-21T07:50:23.520ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55052024-12-21T07:50:23.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55062024-12-21T07:50:23.521ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
55072024-12-21T07:50:23.521ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55082024-12-21T07:50:23.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55092024-12-21T07:50:23.521ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55102024-12-21T07:50:23.522ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55112024-12-21T07:50:23.524ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.657733ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
55122024-12-21T07:50:23.525ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
55132024-12-21T07:50:23.525ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
55142024-12-21T07:50:23.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
55152024-12-21T07:50:23.525ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
55162024-12-21T07:50:23.525ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55172024-12-21T07:50:23.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55182024-12-21T07:50:23.529ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55192024-12-21T07:50:23.531ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1143, tv_nsec: 482773054 } })
55202024-12-21T07:50:23.531ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
55212024-12-21T07:50:23.532ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
55222024-12-21T07:50:23.532ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55232024-12-21T07:50:23.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55242024-12-21T07:50:23.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
55252024-12-21T07:50:23.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
55262024-12-21T07:50:23.542ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55272024-12-21T07:50:23.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
55282024-12-21T07:50:23.545ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
55292024-12-21T07:50:23.545ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
55302024-12-21T07:50:23.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
55312024-12-21T07:50:23.545ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55322024-12-21T07:50:23.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
55332024-12-21T07:50:23.547ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55342024-12-21T07:50:23.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
55352024-12-21T07:50:23.548ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
55362024-12-21T07:50:23.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
55372024-12-21T07:50:23.551ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55382024-12-21T07:50:23.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
55392024-12-21T07:50:23.553ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
55402024-12-21T07:50:23.553ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55412024-12-21T07:50:23.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55422024-12-21T07:50:23.554ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55432024-12-21T07:50:23.555ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55442024-12-21T07:50:23.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55452024-12-21T07:50:23.557ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55462024-12-21T07:50:23.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55472024-12-21T07:50:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
55482024-12-21T07:50:23.559ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55492024-12-21T07:50:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55502024-12-21T07:50:23.574ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55512024-12-21T07:50:23.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55522024-12-21T07:50:23.582ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55532024-12-21T07:50:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
55542024-12-21T07:50:23.585ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55552024-12-21T07:50:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55562024-12-21T07:50:23.590ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55572024-12-21T07:50:23.590ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
55582024-12-21T07:50:23.590ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55592024-12-21T07:50:23.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55602024-12-21T07:50:23.592ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55612024-12-21T07:50:23.597ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55622024-12-21T07:50:23.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55632024-12-21T07:50:23.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55642024-12-21T07:50:23.598ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 91.058462ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
55652024-12-21T07:50:23.600ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55662024-12-21T07:50:23.600ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55672024-12-21T07:50:23.600ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 93.333891ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55682024-12-21T07:50:23.600ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55692024-12-21T07:50:23.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55702024-12-21T07:50:23.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
55712024-12-21T07:50:23.603ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
55722024-12-21T07:50:23.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
55732024-12-21T07:50:23.603ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55742024-12-21T07:50:23.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
55752024-12-21T07:50:23.603ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55762024-12-21T07:50:23.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55772024-12-21T07:50:23.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
55782024-12-21T07:50:23.606ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
55792024-12-21T07:50:23.606ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55802024-12-21T07:50:23.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
55812024-12-21T07:50:23.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
55822024-12-21T07:50:23.609ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
55832024-12-21T07:50:23.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
55842024-12-21T07:50:23.612ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
55852024-12-21T07:50:23.612ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
55862024-12-21T07:50:23.612ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
55872024-12-21T07:50:23.612ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55882024-12-21T07:50:23.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55892024-12-21T07:50:23.614ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
55902024-12-21T07:50:23.614ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
55912024-12-21T07:50:23.614ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 107.828159ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
55922024-12-21T07:50:23.624ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55932024-12-21T07:50:23.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55942024-12-21T07:50:23.626ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
55952024-12-21T07:50:23.633ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 126.738494ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
55962024-12-21T07:50:23.634ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
55972024-12-21T07:50:23.636ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 129.030804ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
55982024-12-21T07:50:23.649ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
55992024-12-21T07:50:23.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
56002024-12-21T07:50:23.655ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1143, tv_nsec: 606744270 } })
56012024-12-21T07:50:23.655ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
56022024-12-21T07:50:23.683ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56032024-12-21T07:50:23.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56042024-12-21T07:50:23.687ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
56052024-12-21T07:50:23.687ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56062024-12-21T07:50:23.687ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9aa0d56-5c76-4f4b-b30f-41658601eafc", "content-length": "26", "date": "Sat, 21 Dec 2024 07:50:23 GMT"} })
56072024-12-21T07:50:23.687ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56082024-12-21T07:50:23.690ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
56092024-12-21T07:50:23.794ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
56102024-12-21T07:50:23.833ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 326.293696ms iteration = 7 status = {}
56112024-12-21T07:50:23.917ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
56122024-12-21T07:50:23.917ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ab425a7f-b2a2-4c40-a704-9e4d890ba46d", "date": "Sat, 21 Dec 2024 07:50:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
56132024-12-21T07:50:23.917ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
56142024-12-21T07:50:23.918ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "09680bf8-e478-4085-9851-2259c23c636c", "date": "Sat, 21 Dec 2024 07:50:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
56152024-12-21T07:50:23.918ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
56162024-12-21T07:50:23.920ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "99e03f4f-76c4-441c-8cfa-f24e12bdbb25", "date": "Sat, 21 Dec 2024 07:50:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
56172024-12-21T07:50:23.920ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
56182024-12-21T07:50:23.922ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
56192024-12-21T07:50:23.923ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 416.229809ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
56202024-12-21T07:50:23.950ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
56212024-12-21T07:50:23.950ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
56222024-12-21T07:50:23.950ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "beaf7913-4b44-4b5c-8813-a39a243eefa1", "content-length": "372", "date": "Sat, 21 Dec 2024 07:50:23 GMT"} })
56232024-12-21T07:50:23.950ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56242024-12-21T07:50:23.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56252024-12-21T07:50:23.952ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56262024-12-21T07:50:23.953ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
56272024-12-21T07:50:23.953ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
56282024-12-21T07:50:23.953ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56292024-12-21T07:50:23.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56302024-12-21T07:50:23.955ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
56312024-12-21T07:50:23.955ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
56322024-12-21T07:50:23.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
56332024-12-21T07:50:23.957ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
56342024-12-21T07:50:23.957ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56352024-12-21T07:50:23.957ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b0d1431-ca58-4ae4-975c-1930ab8d82ef", "content-length": "26", "date": "Sat, 21 Dec 2024 07:50:23 GMT"} })
56362024-12-21T07:50:23.958ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56372024-12-21T07:50:23.958ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
56382024-12-21T07:50:23.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
56392024-12-21T07:50:23.958ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56402024-12-21T07:50:23.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56412024-12-21T07:50:23.959ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
56422024-12-21T07:50:23.960ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 453.369176ms iteration = 3 status = {"nsuccess":5}
56432024-12-21T07:50:23.960ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56442024-12-21T07:50:23.961ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1143, tv_nsec: 912887261 } })
56452024-12-21T07:50:23.961ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56462024-12-21T07:50:23.961ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
56472024-12-21T07:50:23.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56482024-12-21T07:50:23.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
56492024-12-21T07:50:23.964ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56502024-12-21T07:50:23.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56512024-12-21T07:50:23.969ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
56522024-12-21T07:50:23.970ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "062641a1-2785-45ed-b1cd-86cad84f2e97", "date": "Sat, 21 Dec 2024 07:50:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
56532024-12-21T07:50:23.970ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
56542024-12-21T07:50:23.972ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "a0a81a20-5ea7-4c14-8e75-1bf721e7e6d1", "date": "Sat, 21 Dec 2024 07:50:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
56552024-12-21T07:50:23.972ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
56562024-12-21T07:50:23.974ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
56572024-12-21T07:50:23.974ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 467.446277ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
56582024-12-21T07:50:23.995ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56592024-12-21T07:50:23.995ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
56602024-12-21T07:50:23.995ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56612024-12-21T07:50:23.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56622024-12-21T07:50:23.996ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
56632024-12-21T07:50:23.996ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 489.17445ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
56642024-12-21T07:50:24.002ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56652024-12-21T07:50:24.005ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
56662024-12-21T07:50:24.005ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56672024-12-21T07:50:24.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56682024-12-21T07:50:24.005ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56692024-12-21T07:50:24.006ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
56702024-12-21T07:50:24.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
56712024-12-21T07:50:24.007ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 500.27663ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
56722024-12-21T07:50:24.008ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
56732024-12-21T07:50:24.008ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
56742024-12-21T07:50:24.008ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 07:47:23.936594 UTC dns_group = internal generation = 1
56752024-12-21T07:50:24.008ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 502.964747ms iteration = 5 status = {"generation":1}
56762024-12-21T07:50:24.010ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
56772024-12-21T07:50:24.010ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56782024-12-21T07:50:24.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56792024-12-21T07:50:24.012ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 505.872376ms iteration = 7 status = 0
56802024-12-21T07:50:24.014ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
56812024-12-21T07:50:24.014ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 0 version = 2
56822024-12-21T07:50:24.014ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56832024-12-21T07:50:24.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56842024-12-21T07:50:24.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56852024-12-21T07:50:24.019ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
56862024-12-21T07:50:24.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56872024-12-21T07:50:24.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56882024-12-21T07:50:24.024ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
56892024-12-21T07:50:24.024ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
56902024-12-21T07:50:24.024ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "01d962f5-3a04-4f60-bd3f-cc37ce7419c8", "date": "Sat, 21 Dec 2024 07:50:23 GMT"} })
56912024-12-21T07:50:24.024ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56922024-12-21T07:50:24.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56932024-12-21T07:50:24.027ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56942024-12-21T07:50:24.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56952024-12-21T07:50:24.031ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56962024-12-21T07:50:24.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56972024-12-21T07:50:24.035ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
56982024-12-21T07:50:24.035ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
56992024-12-21T07:50:24.035ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57002024-12-21T07:50:24.035ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0855f4df-a4a1-457f-b90a-4cbf872ad6ef", "content-length": "1", "date": "Sat, 21 Dec 2024 07:50:24 GMT"} })
57012024-12-21T07:50:24.035ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5d88809-cff4-43a7-b122-513b224b4bb9", "content-length": "26", "date": "Sat, 21 Dec 2024 07:50:23 GMT"} })
57022024-12-21T07:50:24.035ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57032024-12-21T07:50:24.036ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
57042024-12-21T07:50:24.036ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
57052024-12-21T07:50:24.038ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57062024-12-21T07:50:24.038ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
57072024-12-21T07:50:24.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
57082024-12-21T07:50:24.039ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
57092024-12-21T07:50:24.039ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 532.290209ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
57102024-12-21T07:50:24.039ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57112024-12-21T07:50:24.039ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
57122024-12-21T07:50:24.039ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 532.586785ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
57132024-12-21T07:50:24.040ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 533.187775ms iteration = 7 status = null
57142024-12-21T07:50:24.049ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57152024-12-21T07:50:24.050ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
57162024-12-21T07:50:24.050ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57172024-12-21T07:50:24.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57182024-12-21T07:50:24.053ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57192024-12-21T07:50:24.055ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
57202024-12-21T07:50:24.055ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
57212024-12-21T07:50:24.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
57222024-12-21T07:50:24.058ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 1 version = 2
57232024-12-21T07:50:24.058ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
57242024-12-21T07:50:24.058ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 07:47:25.290148 UTC dns_group = external generation = 2
57252024-12-21T07:50:24.058ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 551.571831ms iteration = 5 status = {"generation":2}
57262024-12-21T07:50:24.072ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
57272024-12-21T07:50:24.072ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 565.51981ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
57282024-12-21T07:50:24.072ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 565.899316ms iteration = 9 status = {"physical_disks_added":0}
57292024-12-21T07:50:24.075ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57302024-12-21T07:50:24.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57312024-12-21T07:50:24.077ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57322024-12-21T07:50:24.079ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
57332024-12-21T07:50:24.079ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57342024-12-21T07:50:24.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57352024-12-21T07:50:24.087ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:47:21.583817Z, time_modified: 2024-12-21T07:47:21.583817Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }) }
57362024-12-21T07:50:24.087ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 580.73497ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]}},"default_endpoint":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
57372024-12-21T07:50:24.107ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57382024-12-21T07:50:24.109ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
57392024-12-21T07:50:24.109ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57402024-12-21T07:50:24.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57412024-12-21T07:50:24.134ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9c5f1938-de01-4cc0-b83b-54b58370606c", "date": "Sat, 21 Dec 2024 07:50:23 GMT"} })
57422024-12-21T07:50:24.136ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 629.299024ms iteration = 8 status = {}
57432024-12-21T07:50:24.138ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57442024-12-21T07:50:24.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57452024-12-21T07:50:24.140ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
57462024-12-21T07:50:24.140ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57472024-12-21T07:50:24.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57482024-12-21T07:50:24.149ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
57492024-12-21T07:50:24.149ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e333c7f9-99bb-45f3-a1ed-33fc7352c8c7", "content-length": "134", "date": "Sat, 21 Dec 2024 07:50:24 GMT"} })
57502024-12-21T07:50:24.149ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
57512024-12-21T07:50:24.149ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
57522024-12-21T07:50:24.150ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
57532024-12-21T07:50:24.150ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
57542024-12-21T07:50:24.150ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57552024-12-21T07:50:24.150ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57562024-12-21T07:50:24.150ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57572024-12-21T07:50:24.150ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
57582024-12-21T07:50:24.150ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57592024-12-21T07:50:24.150ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
57602024-12-21T07:50:24.150ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
57612024-12-21T07:50:24.150ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57622024-12-21T07:50:24.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57632024-12-21T07:50:24.153ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
57642024-12-21T07:50:24.153ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "49dac5e9-8e45-49c2-bd54-76df618b670e", "content-length": "2", "date": "Sat, 21 Dec 2024 07:50:24 GMT"} })
57652024-12-21T07:50:24.153ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
57662024-12-21T07:50:24.153ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e73dad2-0f87-4b3e-b495-41f31df06056", "content-length": "52", "date": "Sat, 21 Dec 2024 07:50:24 GMT"} })
57672024-12-21T07:50:24.153ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
57682024-12-21T07:50:24.153ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
57692024-12-21T07:50:24.200ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
57702024-12-21T07:50:24.240ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe26846f-f92c-4d0f-a1dd-8dea45399b16", "content-length": "691", "date": "Sat, 21 Dec 2024 07:50:24 GMT"} })
57712024-12-21T07:50:24.240ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
57722024-12-21T07:50:24.240ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
57732024-12-21T07:50:24.240ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
57742024-12-21T07:50:24.240ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 734.280654ms iteration = 7 status = {}
57752024-12-21T07:50:24.334ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9cb57c46-c7e2-4b03-a4a1-0f28d61c91b9", "date": "Sat, 21 Dec 2024 07:50:24 GMT"} })
57762024-12-21T07:50:24.334ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
57772024-12-21T07:50:24.334ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
57782024-12-21T07:50:24.335ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "02858e44-fe5d-4f1f-a9ef-bcdb3806c729", "content-length": "682", "date": "Sat, 21 Dec 2024 07:50:24 GMT"} })
57792024-12-21T07:50:24.335ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57802024-12-21T07:50:24.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57812024-12-21T07:50:24.336ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:41826
57822024-12-21T07:50:24.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:41826 req_id = b0cc7cb5-f1d2-46bf-ad26-8ed21b281f9d roles = RoleSet { roles: {} } uri = /metrics/producers
57832024-12-21T07:50:24.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:41826 req_id = b0cc7cb5-f1d2-46bf-ad26-8ed21b281f9d resource = Database result = Ok(()) uri = /metrics/producers
57842024-12-21T07:50:24.338ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57852024-12-21T07:50:24.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57862024-12-21T07:50:24.342ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57872024-12-21T07:50:24.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57882024-12-21T07:50:24.344ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57892024-12-21T07:50:24.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57902024-12-21T07:50:24.351ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 844.595777ms iteration = 7 status = {}
57912024-12-21T07:50:24.377ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
57922024-12-21T07:50:24.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40895 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:41826 req_id = b0cc7cb5-f1d2-46bf-ad26-8ed21b281f9d response_code = 201 uri = /metrics/producers
57932024-12-21T07:50:24.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 2372a6e1-fa71-489a-838d-ca0f611fb3a4 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
57942024-12-21T07:50:24.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 2372a6e1-fa71-489a-838d-ca0f611fb3a4 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
57952024-12-21T07:50:24.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2893 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 2372a6e1-fa71-489a-838d-ca0f611fb3a4 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
57962024-12-21T07:50:25.897ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1287 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 25d3493b-fa6d-4173-b469-538d332fd3db response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
57972024-12-21T07:50:26.115ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:61801
57982024-12-21T07:50:26.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61801 req_id = 4cefce20-1613-469c-91b8-e9fedc720b10 roles = RoleSet { roles: {} } uri = /metrics/producers
57992024-12-21T07:50:26.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61801 req_id = 4cefce20-1613-469c-91b8-e9fedc720b10 resource = Database result = Ok(()) uri = /metrics/producers
58002024-12-21T07:50:26.123ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = 9ad898a3-6e9f-4617-bdb6-642b625a79d4
58012024-12-21T07:50:26.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8845 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61801 req_id = 4cefce20-1613-469c-91b8-e9fedc720b10 response_code = 201 uri = /metrics/producers
58022024-12-21T07:50:33.506ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
58032024-12-21T07:50:33.506ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
58042024-12-21T07:50:33.506ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58052024-12-21T07:50:33.506ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58062024-12-21T07:50:33.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58072024-12-21T07:50:33.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58082024-12-21T07:50:33.508ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58092024-12-21T07:50:33.508ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58102024-12-21T07:50:33.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58112024-12-21T07:50:33.510ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58122024-12-21T07:50:33.510ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58132024-12-21T07:50:33.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58142024-12-21T07:50:33.512ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58152024-12-21T07:50:33.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58162024-12-21T07:50:33.514ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58172024-12-21T07:50:33.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
58182024-12-21T07:50:33.516ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58192024-12-21T07:50:33.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58202024-12-21T07:50:33.528ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
58212024-12-21T07:50:33.528ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.950866ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
58222024-12-21T07:50:33.538ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.907797ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58232024-12-21T07:50:33.682ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:33305
58242024-12-21T07:50:33.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33305 req_id = 9b7ef635-ae7b-48b2-a176-f6cad81d3adb roles = RoleSet { roles: {} } uri = /metrics/producers
58252024-12-21T07:50:33.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33305 req_id = 9b7ef635-ae7b-48b2-a176-f6cad81d3adb resource = Database result = Ok(()) uri = /metrics/producers
58262024-12-21T07:50:33.717ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = 34be787b-2c60-4915-afd0-2c1a7062ad84
58272024-12-21T07:50:33.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35177 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33305 req_id = 9b7ef635-ae7b-48b2-a176-f6cad81d3adb response_code = 201 uri = /metrics/producers
58282024-12-21T07:50:35.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = bfe06b15-b714-4602-a665-eddb38a6bffd roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
58292024-12-21T07:50:35.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = bfe06b15-b714-4602-a665-eddb38a6bffd resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
58302024-12-21T07:50:35.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2510 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = bfe06b15-b714-4602-a665-eddb38a6bffd response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
58312024-12-21T07:50:35.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 048c032a-f7ac-406f-bff3-64036a490c3a roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
58322024-12-21T07:50:35.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 048c032a-f7ac-406f-bff3-64036a490c3a resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
58332024-12-21T07:50:35.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2670 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 048c032a-f7ac-406f-bff3-64036a490c3a response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
58342024-12-21T07:50:35.896ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1040 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = e537ce5b-1d0b-4baa-99a9-2bbdd3475df3 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
58352024-12-21T07:50:43.506ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
58362024-12-21T07:50:43.506ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
58372024-12-21T07:50:43.506ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58382024-12-21T07:50:43.506ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58392024-12-21T07:50:43.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58402024-12-21T07:50:43.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58412024-12-21T07:50:43.508ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58422024-12-21T07:50:43.510ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58432024-12-21T07:50:43.510ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58442024-12-21T07:50:43.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58452024-12-21T07:50:43.515ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58462024-12-21T07:50:43.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58472024-12-21T07:50:43.517ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58482024-12-21T07:50:43.519ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
58492024-12-21T07:50:43.519ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58502024-12-21T07:50:43.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58512024-12-21T07:50:43.532ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
58522024-12-21T07:50:43.532ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.21534ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
58532024-12-21T07:50:43.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58542024-12-21T07:50:43.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58552024-12-21T07:50:43.571ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.716707ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58562024-12-21T07:50:45.897ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1155 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 4419bfe1-c9ab-468e-adb7-a71e53756747 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
58572024-12-21T07:50:53.507ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
58582024-12-21T07:50:53.507ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
58592024-12-21T07:50:53.507ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
58602024-12-21T07:50:53.507ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58612024-12-21T07:50:53.507ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
58622024-12-21T07:50:53.507ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
58632024-12-21T07:50:53.507ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58642024-12-21T07:50:53.507ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58652024-12-21T07:50:53.507ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
58662024-12-21T07:50:53.507ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
58672024-12-21T07:50:53.507ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58682024-12-21T07:50:53.507ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58692024-12-21T07:50:53.507ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
58702024-12-21T07:50:53.507ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58712024-12-21T07:50:53.507ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
58722024-12-21T07:50:53.507ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58732024-12-21T07:50:53.507ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
58742024-12-21T07:50:53.507ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
58752024-12-21T07:50:53.507ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
58762024-12-21T07:50:53.507ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58772024-12-21T07:50:53.507ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
58782024-12-21T07:50:53.507ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
58792024-12-21T07:50:53.507ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58802024-12-21T07:50:53.507ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
58812024-12-21T07:50:53.507ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
58822024-12-21T07:50:53.507ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58832024-12-21T07:50:53.507ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
58842024-12-21T07:50:53.507ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
58852024-12-21T07:50:53.507ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
58862024-12-21T07:50:53.507ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58872024-12-21T07:50:53.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58882024-12-21T07:50:53.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
58892024-12-21T07:50:53.507ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
58902024-12-21T07:50:53.507ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
58912024-12-21T07:50:53.507ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
58922024-12-21T07:50:53.507ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
58932024-12-21T07:50:53.507ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58942024-12-21T07:50:53.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58952024-12-21T07:50:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58962024-12-21T07:50:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58972024-12-21T07:50:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58982024-12-21T07:50:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58992024-12-21T07:50:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59002024-12-21T07:50:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59012024-12-21T07:50:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
59022024-12-21T07:50:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59032024-12-21T07:50:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59042024-12-21T07:50:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
59052024-12-21T07:50:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59062024-12-21T07:50:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
59072024-12-21T07:50:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
59082024-12-21T07:50:53.512ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.882924ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
59092024-12-21T07:50:53.512ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59102024-12-21T07:50:53.512ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59112024-12-21T07:50:53.515ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
59122024-12-21T07:50:53.515ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
59132024-12-21T07:50:53.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
59142024-12-21T07:50:53.515ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59152024-12-21T07:50:53.515ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59162024-12-21T07:50:53.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59172024-12-21T07:50:53.518ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59182024-12-21T07:50:53.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59192024-12-21T07:50:53.518ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59202024-12-21T07:50:53.521ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
59212024-12-21T07:50:53.521ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59222024-12-21T07:50:53.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59232024-12-21T07:50:53.521ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59242024-12-21T07:50:53.521ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
59252024-12-21T07:50:53.521ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59262024-12-21T07:50:53.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59272024-12-21T07:50:53.528ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59282024-12-21T07:50:53.530ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
59292024-12-21T07:50:53.530ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59302024-12-21T07:50:53.530ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59312024-12-21T07:50:53.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59322024-12-21T07:50:53.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59332024-12-21T07:50:53.532ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59342024-12-21T07:50:53.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59352024-12-21T07:50:53.533ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59362024-12-21T07:50:53.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59372024-12-21T07:50:53.534ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59382024-12-21T07:50:53.535ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59392024-12-21T07:50:53.535ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1173, tv_nsec: 486715821 } })
59402024-12-21T07:50:53.535ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1173, tv_nsec: 486935225 } })
59412024-12-21T07:50:53.535ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
59422024-12-21T07:50:53.536ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
59432024-12-21T07:50:53.536ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
59442024-12-21T07:50:53.536ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59452024-12-21T07:50:53.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59462024-12-21T07:50:53.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59472024-12-21T07:50:53.538ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59482024-12-21T07:50:53.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59492024-12-21T07:50:53.545ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59502024-12-21T07:50:53.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59512024-12-21T07:50:53.563ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 56.324606ms iteration = 8 status = {"errors":[],"finish_invoked_ok":[]}
59522024-12-21T07:50:53.564ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 56.903106ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
59532024-12-21T07:50:53.568ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59542024-12-21T07:50:53.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59552024-12-21T07:50:53.570ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59562024-12-21T07:50:53.570ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
59572024-12-21T07:50:53.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
59582024-12-21T07:50:53.573ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
59592024-12-21T07:50:53.573ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59602024-12-21T07:50:53.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59612024-12-21T07:50:53.573ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.322488ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59622024-12-21T07:50:53.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59632024-12-21T07:50:53.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59642024-12-21T07:50:53.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
59652024-12-21T07:50:53.576ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59662024-12-21T07:50:53.576ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
59672024-12-21T07:50:53.576ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59682024-12-21T07:50:53.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59692024-12-21T07:50:53.576ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59702024-12-21T07:50:53.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59712024-12-21T07:50:53.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59722024-12-21T07:50:53.588ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59732024-12-21T07:50:53.588ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
59742024-12-21T07:50:53.588ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 81.396856ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
59752024-12-21T07:50:53.590ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59762024-12-21T07:50:53.590ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59772024-12-21T07:50:53.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59782024-12-21T07:50:53.607ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
59792024-12-21T07:50:53.607ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59802024-12-21T07:50:53.607ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0542c3e-c928-402a-b7ba-1d0cbc7b9cef", "content-length": "26", "date": "Sat, 21 Dec 2024 07:50:53 GMT"} })
59812024-12-21T07:50:53.607ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59822024-12-21T07:50:53.609ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59832024-12-21T07:50:53.611ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
59842024-12-21T07:50:53.611ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59852024-12-21T07:50:53.612ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4aae9213-7919-4a1d-8019-886b717195f2", "content-length": "26", "date": "Sat, 21 Dec 2024 07:50:53 GMT"} })
59862024-12-21T07:50:53.612ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59872024-12-21T07:50:53.615ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59882024-12-21T07:50:53.644ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
59892024-12-21T07:50:53.644ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59902024-12-21T07:50:53.645ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "52644ad6-ea0e-4e0b-9be0-270451dfcb1d", "content-length": "372", "date": "Sat, 21 Dec 2024 07:50:53 GMT"} })
59912024-12-21T07:50:53.645ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59922024-12-21T07:50:53.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59932024-12-21T07:50:53.648ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1173, tv_nsec: 599875542 } })
59942024-12-21T07:50:53.649ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
59952024-12-21T07:50:53.650ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59962024-12-21T07:50:53.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59972024-12-21T07:50:53.656ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59982024-12-21T07:50:53.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59992024-12-21T07:50:53.659ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60002024-12-21T07:50:53.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60012024-12-21T07:50:53.670ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
60022024-12-21T07:50:53.670ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
60032024-12-21T07:50:53.670ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ee70aa1a-d1eb-4727-9425-743129e6c6fa", "date": "Sat, 21 Dec 2024 07:50:53 GMT"} })
60042024-12-21T07:50:53.670ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60052024-12-21T07:50:53.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60062024-12-21T07:50:53.675ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60072024-12-21T07:50:53.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60082024-12-21T07:50:53.679ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60092024-12-21T07:50:53.679ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 172.730723ms iteration = 10 status = {"physical_disks_added":0}
60102024-12-21T07:50:53.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60112024-12-21T07:50:53.684ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
60122024-12-21T07:50:53.684ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
60132024-12-21T07:50:53.684ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "70775aa0-2e1f-4a79-8142-096d45b48c88", "date": "Sat, 21 Dec 2024 07:50:53 GMT"} })
60142024-12-21T07:50:53.686ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60152024-12-21T07:50:53.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60162024-12-21T07:50:53.686ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 179.00671ms iteration = 9 status = {}
60172024-12-21T07:50:53.694ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
60182024-12-21T07:50:53.694ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
60192024-12-21T07:50:53.694ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 186.886745ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
60202024-12-21T07:50:53.694ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 187.446985ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
60212024-12-21T07:50:53.695ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 187.537236ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
60222024-12-21T07:50:53.695ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60232024-12-21T07:50:53.696ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 188.85928ms iteration = 8 status = {}
60242024-12-21T07:50:53.697ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
60252024-12-21T07:50:53.698ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60262024-12-21T07:50:53.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60272024-12-21T07:50:53.698ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60282024-12-21T07:50:53.699ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60292024-12-21T07:50:53.700ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
60302024-12-21T07:50:53.701ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "816d89a6-b57a-4867-b9d1-7b4ed420355d", "content-length": "1", "date": "Sat, 21 Dec 2024 07:50:53 GMT"} })
60312024-12-21T07:50:53.702ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
60322024-12-21T07:50:53.702ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60332024-12-21T07:50:53.702ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
60342024-12-21T07:50:53.702ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
60352024-12-21T07:50:53.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60362024-12-21T07:50:53.702ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60372024-12-21T07:50:53.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
60382024-12-21T07:50:53.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60392024-12-21T07:50:53.705ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 197.452627ms iteration = 8 status = null
60402024-12-21T07:50:53.705ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 198.158739ms iteration = 8 status = 0
60412024-12-21T07:50:53.714ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
60422024-12-21T07:50:53.714ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 206.660345ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
60432024-12-21T07:50:53.714ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
60442024-12-21T07:50:53.714ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60452024-12-21T07:50:53.714ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf711bcc-3585-4ab0-ad2e-9e42d8f6a4bf", "content-length": "26", "date": "Sat, 21 Dec 2024 07:50:53 GMT"} })
60462024-12-21T07:50:53.714ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60472024-12-21T07:50:53.716ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
60482024-12-21T07:50:53.720ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 212.625477ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
60492024-12-21T07:50:53.796ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
60502024-12-21T07:50:53.796ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e3b3a85-59cd-4c62-b86b-abc9bd2c8ff0", "content-length": "691", "date": "Sat, 21 Dec 2024 07:50:53 GMT"} })
60512024-12-21T07:50:53.796ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
60522024-12-21T07:50:53.796ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
60532024-12-21T07:50:53.797ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
60542024-12-21T07:50:53.799ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 291.855395ms iteration = 8 status = {}
60552024-12-21T07:50:53.817ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60562024-12-21T07:50:53.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60572024-12-21T07:50:53.819ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
60582024-12-21T07:50:53.819ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60592024-12-21T07:50:53.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60602024-12-21T07:50:53.829ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
60612024-12-21T07:50:53.829ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a4100fa-d751-458a-bbb2-6381201e2b92", "content-length": "134", "date": "Sat, 21 Dec 2024 07:50:53 GMT"} })
60622024-12-21T07:50:53.829ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
60632024-12-21T07:50:53.829ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
60642024-12-21T07:50:53.830ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
60652024-12-21T07:50:53.830ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
60662024-12-21T07:50:53.830ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60672024-12-21T07:50:53.830ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60682024-12-21T07:50:53.830ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60692024-12-21T07:50:53.830ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
60702024-12-21T07:50:53.830ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60712024-12-21T07:50:53.830ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
60722024-12-21T07:50:53.830ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
60732024-12-21T07:50:53.830ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60742024-12-21T07:50:53.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60752024-12-21T07:50:53.832ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
60762024-12-21T07:50:53.832ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "223b1faf-aeb1-408b-8440-9fd45cdbee81", "content-length": "2", "date": "Sat, 21 Dec 2024 07:50:53 GMT"} })
60772024-12-21T07:50:53.832ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
60782024-12-21T07:50:53.833ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "36d97af2-9dae-4e43-8f72-e2b98acc730e", "content-length": "52", "date": "Sat, 21 Dec 2024 07:50:53 GMT"} })
60792024-12-21T07:50:53.833ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
60802024-12-21T07:50:53.833ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
60812024-12-21T07:50:54.020ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c5fae4fa-ec65-4b73-9843-7ea77661bd80", "date": "Sat, 21 Dec 2024 07:50:53 GMT"} })
60822024-12-21T07:50:54.020ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
60832024-12-21T07:50:54.020ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
60842024-12-21T07:50:54.024ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "44e69c9d-d7d5-4182-8e3b-a208d9aeec35", "content-length": "682", "date": "Sat, 21 Dec 2024 07:50:53 GMT"} })
60852024-12-21T07:50:54.024ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60862024-12-21T07:50:54.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60872024-12-21T07:50:54.028ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60882024-12-21T07:50:54.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60892024-12-21T07:50:54.031ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60902024-12-21T07:50:54.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60912024-12-21T07:50:54.033ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60922024-12-21T07:50:54.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60932024-12-21T07:50:54.041ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 533.768565ms iteration = 8 status = {}
60942024-12-21T07:50:54.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 83691f6b-5577-4063-9e81-92e4225f4eb2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
60952024-12-21T07:50:54.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 83691f6b-5577-4063-9e81-92e4225f4eb2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
60962024-12-21T07:50:54.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3313 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 83691f6b-5577-4063-9e81-92e4225f4eb2 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
60972024-12-21T07:50:55.896ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1122 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 93cd699d-8c81-44ff-970c-f65e25309044 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
60982024-12-21T07:51:03.507ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
60992024-12-21T07:51:03.507ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
61002024-12-21T07:51:03.507ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61012024-12-21T07:51:03.507ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61022024-12-21T07:51:03.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61032024-12-21T07:51:03.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61042024-12-21T07:51:03.509ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61052024-12-21T07:51:03.511ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61062024-12-21T07:51:03.511ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61072024-12-21T07:51:03.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61082024-12-21T07:51:03.513ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61092024-12-21T07:51:03.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61102024-12-21T07:51:03.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61112024-12-21T07:51:03.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61122024-12-21T07:51:03.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61132024-12-21T07:51:03.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
61142024-12-21T07:51:03.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61152024-12-21T07:51:03.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61162024-12-21T07:51:03.561ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
61172024-12-21T07:51:03.561ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.729399ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
61182024-12-21T07:51:03.564ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.038048ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61192024-12-21T07:51:05.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 3e2d252e-ab32-45bd-b207-d4101f915c4e roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
61202024-12-21T07:51:05.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 3e2d252e-ab32-45bd-b207-d4101f915c4e resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
61212024-12-21T07:51:05.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3434 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 3e2d252e-ab32-45bd-b207-d4101f915c4e response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
61222024-12-21T07:51:05.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 417b1b2e-cd5a-4a9a-a565-bae9f6ac1573 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
61232024-12-21T07:51:05.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 417b1b2e-cd5a-4a9a-a565-bae9f6ac1573 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
61242024-12-21T07:51:05.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2374 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 417b1b2e-cd5a-4a9a-a565-bae9f6ac1573 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
61252024-12-21T07:51:05.897ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1083 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 1cd2b299-eeed-4e47-9dd7-6d51bf1fe6f2 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
61262024-12-21T07:51:13.506ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
61272024-12-21T07:51:13.507ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
61282024-12-21T07:51:13.507ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61292024-12-21T07:51:13.507ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61302024-12-21T07:51:13.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61312024-12-21T07:51:13.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61322024-12-21T07:51:13.508ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61332024-12-21T07:51:13.509ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61342024-12-21T07:51:13.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61352024-12-21T07:51:13.511ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61362024-12-21T07:51:13.511ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61372024-12-21T07:51:13.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61382024-12-21T07:51:13.511ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.861003ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61392024-12-21T07:51:13.513ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61402024-12-21T07:51:13.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61412024-12-21T07:51:13.515ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61422024-12-21T07:51:13.518ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
61432024-12-21T07:51:13.518ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61442024-12-21T07:51:13.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61452024-12-21T07:51:13.526ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
61462024-12-21T07:51:13.526ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.770139ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
61472024-12-21T07:51:15.897ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1266 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 69d6486e-fe10-48c5-bb05-87eb0c30162d response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
61482024-12-21T07:51:23.506ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
61492024-12-21T07:51:23.506ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
61502024-12-21T07:51:23.506ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61512024-12-21T07:51:23.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61522024-12-21T07:51:23.506ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
61532024-12-21T07:51:23.506ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
61542024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
61552024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61562024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
61572024-12-21T07:51:23.507ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:41:23.507042999 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
61582024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
61592024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
61602024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
61612024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61622024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
61632024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
61642024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
61652024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
61662024-12-21T07:51:23.507ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
61672024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
61682024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61692024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
61702024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61712024-12-21T07:51:23.507ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
61722024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
61732024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
61742024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
61752024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
61762024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61772024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
61782024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
61792024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
61802024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
61812024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
61822024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
61832024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
61842024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61852024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
61862024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
61872024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
61882024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
61892024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
61902024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
61912024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
61922024-12-21T07:51:23.507ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 3f45718f-9869-448a-a087-788e66db5e9d
61932024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.46\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"3f45718f-9869-448a-a087-788e66db5e9d"}
61942024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
61952024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
61962024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
61972024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
61982024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
61992024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
62002024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
62012024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62022024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
62032024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
62042024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
62052024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62062024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
62072024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62082024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
62092024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
62102024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62112024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62122024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62132024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
62142024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62152024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
62162024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62172024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62182024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
62192024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62202024-12-21T07:51:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62212024-12-21T07:51:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
62222024-12-21T07:51:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
62232024-12-21T07:51:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62242024-12-21T07:51:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62252024-12-21T07:51:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
62262024-12-21T07:51:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
62272024-12-21T07:51:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
62282024-12-21T07:51:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62292024-12-21T07:51:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62302024-12-21T07:51:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62312024-12-21T07:51:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62322024-12-21T07:51:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62332024-12-21T07:51:23.508ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1595c632-cfae-4f6b-937d-d413dd8cf0b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1203, tv_nsec: 459055917 } })
62342024-12-21T07:51:23.508ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("481de7e8-0737-474b-8c33-e6e8bc6477be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("683a9892-43cd-4dd8-a983-26cccd988df0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1203, tv_nsec: 459060807 } })
62352024-12-21T07:51:23.508ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
62362024-12-21T07:51:23.508ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.571287ms iteration = 6 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
62372024-12-21T07:51:23.508ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
62382024-12-21T07:51:23.508ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.450915ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
62392024-12-21T07:51:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62402024-12-21T07:51:23.509ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62412024-12-21T07:51:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62422024-12-21T07:51:23.517ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62432024-12-21T07:51:23.518ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1203, tv_nsec: 468999747 } })
62442024-12-21T07:51:23.518ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:41:23.507042999 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
62452024-12-21T07:51:23.518ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
62462024-12-21T07:51:23.518ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.352415ms iteration = 5 status = {"expiration":"2024-12-21T07:41:23.507042999Z","pruned":[]}
62472024-12-21T07:51:23.519ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62482024-12-21T07:51:23.520ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 13.322238ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
62492024-12-21T07:51:23.520ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62502024-12-21T07:51:23.521ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62512024-12-21T07:51:23.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62522024-12-21T07:51:23.521ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.713813ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
62532024-12-21T07:51:23.522ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
62542024-12-21T07:51:23.522ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62552024-12-21T07:51:23.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62562024-12-21T07:51:23.526ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62572024-12-21T07:51:23.529ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
62582024-12-21T07:51:23.529ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62592024-12-21T07:51:23.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62602024-12-21T07:51:23.531ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62612024-12-21T07:51:23.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62622024-12-21T07:51:23.536ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1203, tv_nsec: 487219320 } })
62632024-12-21T07:51:23.536ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
62642024-12-21T07:51:23.542ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62652024-12-21T07:51:23.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62662024-12-21T07:51:23.544ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62672024-12-21T07:51:23.546ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62682024-12-21T07:51:23.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62692024-12-21T07:51:23.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
62702024-12-21T07:51:23.578ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62712024-12-21T07:51:23.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62722024-12-21T07:51:23.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62732024-12-21T07:51:23.585ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62742024-12-21T07:51:23.586ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62752024-12-21T07:51:23.586ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
62762024-12-21T07:51:23.586ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62772024-12-21T07:51:23.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62782024-12-21T07:51:23.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62792024-12-21T07:51:23.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62802024-12-21T07:51:23.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62812024-12-21T07:51:23.587ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62822024-12-21T07:51:23.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
62832024-12-21T07:51:23.589ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62842024-12-21T07:51:23.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62852024-12-21T07:51:23.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
62862024-12-21T07:51:23.590ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
62872024-12-21T07:51:23.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
62882024-12-21T07:51:23.591ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
62892024-12-21T07:51:23.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62902024-12-21T07:51:23.592ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 84.977398ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
62912024-12-21T07:51:23.594ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
62922024-12-21T07:51:23.594ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
62932024-12-21T07:51:23.594ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 87.320877ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
62942024-12-21T07:51:23.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62952024-12-21T07:51:23.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62962024-12-21T07:51:23.601ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62972024-12-21T07:51:23.601ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
62982024-12-21T07:51:23.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62992024-12-21T07:51:23.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63002024-12-21T07:51:23.601ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63012024-12-21T07:51:23.604ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
63022024-12-21T07:51:23.604ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63032024-12-21T07:51:23.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63042024-12-21T07:51:23.607ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63052024-12-21T07:51:23.609ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
63062024-12-21T07:51:23.610ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63072024-12-21T07:51:23.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63082024-12-21T07:51:23.610ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63092024-12-21T07:51:23.612ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
63102024-12-21T07:51:23.612ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 104.835098ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
63112024-12-21T07:51:23.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
63122024-12-21T07:51:23.615ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63132024-12-21T07:51:23.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63142024-12-21T07:51:23.617ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
63152024-12-21T07:51:23.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
63162024-12-21T07:51:23.619ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63172024-12-21T07:51:23.619ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 112.582131ms iteration = 9 status = {"errors":[],"finish_invoked_ok":[]}
63182024-12-21T07:51:23.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63192024-12-21T07:51:23.620ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63202024-12-21T07:51:23.620ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1203, tv_nsec: 571901583 } })
63212024-12-21T07:51:23.621ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
63222024-12-21T07:51:23.621ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63232024-12-21T07:51:23.624ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63242024-12-21T07:51:23.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
63252024-12-21T07:51:23.626ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
63262024-12-21T07:51:23.626ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
63272024-12-21T07:51:23.626ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
63282024-12-21T07:51:23.626ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63292024-12-21T07:51:23.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63302024-12-21T07:51:23.628ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
63312024-12-21T07:51:23.628ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63322024-12-21T07:51:23.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63332024-12-21T07:51:23.629ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
63342024-12-21T07:51:23.629ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63352024-12-21T07:51:23.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63362024-12-21T07:51:23.630ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 123.955507ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63372024-12-21T07:51:23.636ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63382024-12-21T07:51:23.637ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63392024-12-21T07:51:23.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63402024-12-21T07:51:23.639ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
63412024-12-21T07:51:23.641ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
63422024-12-21T07:51:23.641ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63432024-12-21T07:51:23.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63442024-12-21T07:51:23.657ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
63452024-12-21T07:51:23.658ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63462024-12-21T07:51:23.658ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e74367a-f5b8-41cf-a6af-d8def981ae7b", "content-length": "26", "date": "Sat, 21 Dec 2024 07:51:23 GMT"} })
63472024-12-21T07:51:23.658ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63482024-12-21T07:51:23.661ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63492024-12-21T07:51:23.665ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 158.732522ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
63502024-12-21T07:51:23.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63512024-12-21T07:51:23.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
63522024-12-21T07:51:23.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63532024-12-21T07:51:23.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63542024-12-21T07:51:23.676ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
63552024-12-21T07:51:23.676ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
63562024-12-21T07:51:23.676ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 169.580499ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
63572024-12-21T07:51:23.680ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63582024-12-21T07:51:23.680ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
63592024-12-21T07:51:23.680ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 173.046638ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
63602024-12-21T07:51:23.680ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
63612024-12-21T07:51:23.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
63622024-12-21T07:51:23.681ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
63632024-12-21T07:51:23.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
63642024-12-21T07:51:23.690ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
63652024-12-21T07:51:23.690ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 183.280043ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
63662024-12-21T07:51:23.712ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 205.692169ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
63672024-12-21T07:51:23.713ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
63682024-12-21T07:51:23.713ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
63692024-12-21T07:51:23.713ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63702024-12-21T07:51:23.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63712024-12-21T07:51:23.715ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63722024-12-21T07:51:23.716ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63732024-12-21T07:51:23.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63742024-12-21T07:51:23.720ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63752024-12-21T07:51:23.720ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
63762024-12-21T07:51:23.720ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63772024-12-21T07:51:23.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63782024-12-21T07:51:23.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63792024-12-21T07:51:23.722ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
63802024-12-21T07:51:23.722ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
63812024-12-21T07:51:23.722ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
63822024-12-21T07:51:23.722ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63832024-12-21T07:51:23.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63842024-12-21T07:51:23.723ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63852024-12-21T07:51:23.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63862024-12-21T07:51:23.724ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
63872024-12-21T07:51:23.724ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
63882024-12-21T07:51:23.724ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 07:47:23.936594 UTC dns_group = internal generation = 1
63892024-12-21T07:51:23.724ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 218.115361ms iteration = 6 status = {"generation":1}
63902024-12-21T07:51:23.725ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63912024-12-21T07:51:23.725ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63922024-12-21T07:51:23.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
63932024-12-21T07:51:23.730ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63942024-12-21T07:51:23.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
63952024-12-21T07:51:23.731ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63962024-12-21T07:51:23.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63972024-12-21T07:51:23.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63982024-12-21T07:51:23.733ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 226.285582ms iteration = 9 status = 0
63992024-12-21T07:51:23.735ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
64002024-12-21T07:51:23.735ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64012024-12-21T07:51:23.735ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec6348b6-2382-4e44-a7e4-189b6a1804c7", "content-length": "26", "date": "Sat, 21 Dec 2024 07:51:23 GMT"} })
64022024-12-21T07:51:23.735ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64032024-12-21T07:51:23.739ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 232.02513ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
64042024-12-21T07:51:23.739ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
64052024-12-21T07:51:23.749ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64062024-12-21T07:51:23.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64072024-12-21T07:51:23.758ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64082024-12-21T07:51:23.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64092024-12-21T07:51:23.760ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64102024-12-21T07:51:23.763ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
64112024-12-21T07:51:23.763ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64122024-12-21T07:51:23.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64132024-12-21T07:51:23.765ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64142024-12-21T07:51:23.766ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64152024-12-21T07:51:23.769ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
64162024-12-21T07:51:23.769ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64172024-12-21T07:51:23.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64182024-12-21T07:51:23.770ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
64192024-12-21T07:51:23.770ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
64202024-12-21T07:51:23.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
64212024-12-21T07:51:23.782ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
64222024-12-21T07:51:23.782ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 0 version = 2
64232024-12-21T07:51:23.782ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64242024-12-21T07:51:23.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64252024-12-21T07:51:23.788ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 281.418867ms iteration = 11 status = {"physical_disks_added":0}
64262024-12-21T07:51:23.799ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 292.418065ms iteration = 9 status = {}
64272024-12-21T07:51:23.810ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
64282024-12-21T07:51:23.810ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 302.675031ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
64292024-12-21T07:51:23.822ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
64302024-12-21T07:51:23.832ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
64312024-12-21T07:51:23.832ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "4699edf0-14eb-479f-af1f-f948adee1aa5", "date": "Sat, 21 Dec 2024 07:51:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
64322024-12-21T07:51:23.832ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
64332024-12-21T07:51:23.834ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "e094a07b-c67f-41b5-9d8d-1d18ab90bd89", "date": "Sat, 21 Dec 2024 07:51:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
64342024-12-21T07:51:23.834ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
64352024-12-21T07:51:23.836ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
64362024-12-21T07:51:23.836ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 329.42153ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
64372024-12-21T07:51:23.847ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
64382024-12-21T07:51:23.847ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64392024-12-21T07:51:23.847ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "887c60c8-1216-4321-9ed2-7ff22c19fdd2", "content-length": "26", "date": "Sat, 21 Dec 2024 07:51:23 GMT"} })
64402024-12-21T07:51:23.847ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64412024-12-21T07:51:23.849ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
64422024-12-21T07:51:23.882ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
64432024-12-21T07:51:23.882ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64442024-12-21T07:51:23.882ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "30925a49-710e-4622-8629-d27b1f29a9fb", "content-length": "372", "date": "Sat, 21 Dec 2024 07:51:23 GMT"} })
64452024-12-21T07:51:23.882ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64462024-12-21T07:51:23.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64472024-12-21T07:51:23.885ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64482024-12-21T07:51:23.888ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
64492024-12-21T07:51:23.888ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64502024-12-21T07:51:23.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64512024-12-21T07:51:23.894ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 1 version = 2
64522024-12-21T07:51:23.894ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
64532024-12-21T07:51:23.894ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 07:47:25.290148 UTC dns_group = external generation = 2
64542024-12-21T07:51:23.894ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 386.673243ms iteration = 6 status = {"generation":2}
64552024-12-21T07:51:23.931ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:47:21.583817Z, time_modified: 2024-12-21T07:47:21.583817Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }) }
64562024-12-21T07:51:23.931ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 424.533021ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]}},"default_endpoint":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
64572024-12-21T07:51:23.937ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
64582024-12-21T07:51:23.937ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
64592024-12-21T07:51:23.937ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f1b200f4-ba18-458f-8be9-1f6dc45fea7a", "date": "Sat, 21 Dec 2024 07:51:23 GMT"} })
64602024-12-21T07:51:23.937ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64612024-12-21T07:51:23.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64622024-12-21T07:51:23.987ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64632024-12-21T07:51:23.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64642024-12-21T07:51:23.990ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64652024-12-21T07:51:23.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64662024-12-21T07:51:23.998ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
64672024-12-21T07:51:23.998ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64682024-12-21T07:51:23.999ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "302c5339-ff03-4a81-82c8-2adeb4c5c92a", "date": "Sat, 21 Dec 2024 07:51:23 GMT"} })
64692024-12-21T07:51:24.001ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 494.298458ms iteration = 10 status = {}
64702024-12-21T07:51:24.016ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
64712024-12-21T07:51:24.016ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c8b1860-d552-4057-9a71-6f0386dea53e", "content-length": "1", "date": "Sat, 21 Dec 2024 07:51:23 GMT"} })
64722024-12-21T07:51:24.018ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
64732024-12-21T07:51:24.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
64742024-12-21T07:51:24.020ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 513.782002ms iteration = 9 status = null
64752024-12-21T07:51:24.028ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
64762024-12-21T07:51:24.049ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
64772024-12-21T07:51:24.076ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
64782024-12-21T07:51:24.077ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "64837e04-7051-4373-9933-dd4912b3831b", "date": "Sat, 21 Dec 2024 07:51:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
64792024-12-21T07:51:24.077ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
64802024-12-21T07:51:24.078ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "68d28234-39b2-4b18-b17b-d2e8155f07d2", "date": "Sat, 21 Dec 2024 07:51:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
64812024-12-21T07:51:24.078ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
64822024-12-21T07:51:24.080ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "95969525-d912-4ce2-8fdf-46c64bdfa648", "date": "Sat, 21 Dec 2024 07:51:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
64832024-12-21T07:51:24.080ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
64842024-12-21T07:51:24.082ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
64852024-12-21T07:51:24.082ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 574.663957ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
64862024-12-21T07:51:24.102ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64872024-12-21T07:51:24.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64882024-12-21T07:51:24.104ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
64892024-12-21T07:51:24.104ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64902024-12-21T07:51:24.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64912024-12-21T07:51:24.119ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
64922024-12-21T07:51:24.119ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e33e918-9a3e-40d5-b649-912750c55611", "content-length": "134", "date": "Sat, 21 Dec 2024 07:51:24 GMT"} })
64932024-12-21T07:51:24.119ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
64942024-12-21T07:51:24.119ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
64952024-12-21T07:51:24.120ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
64962024-12-21T07:51:24.120ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
64972024-12-21T07:51:24.120ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64982024-12-21T07:51:24.120ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64992024-12-21T07:51:24.120ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65002024-12-21T07:51:24.120ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
65012024-12-21T07:51:24.120ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65022024-12-21T07:51:24.120ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
65032024-12-21T07:51:24.120ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
65042024-12-21T07:51:24.120ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65052024-12-21T07:51:24.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65062024-12-21T07:51:24.123ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
65072024-12-21T07:51:24.123ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d0298b1-0b0a-412f-adee-a7856f729cf3", "content-length": "2", "date": "Sat, 21 Dec 2024 07:51:24 GMT"} })
65082024-12-21T07:51:24.123ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
65092024-12-21T07:51:24.123ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e636c0be-697f-43c2-875e-c03d5c670246", "content-length": "52", "date": "Sat, 21 Dec 2024 07:51:24 GMT"} })
65102024-12-21T07:51:24.123ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
65112024-12-21T07:51:24.123ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
65122024-12-21T07:51:24.151ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "23a297de-0356-473e-a358-26b4048f2944", "content-length": "691", "date": "Sat, 21 Dec 2024 07:51:24 GMT"} })
65132024-12-21T07:51:24.151ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
65142024-12-21T07:51:24.151ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
65152024-12-21T07:51:24.151ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
65162024-12-21T07:51:24.152ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 645.347919ms iteration = 9 status = {}
65172024-12-21T07:51:24.237ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "55c12601-808d-4663-9352-39f5203d099c", "date": "Sat, 21 Dec 2024 07:51:23 GMT"} })
65182024-12-21T07:51:24.237ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
65192024-12-21T07:51:24.237ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
65202024-12-21T07:51:24.238ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9a38a9f-5fe8-4303-87e2-0d85ccf85a96", "content-length": "682", "date": "Sat, 21 Dec 2024 07:51:24 GMT"} })
65212024-12-21T07:51:24.238ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65222024-12-21T07:51:24.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65232024-12-21T07:51:24.241ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65242024-12-21T07:51:24.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65252024-12-21T07:51:24.244ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65262024-12-21T07:51:24.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65272024-12-21T07:51:24.246ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65282024-12-21T07:51:24.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65292024-12-21T07:51:24.254ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 747.317048ms iteration = 9 status = {}
65302024-12-21T07:51:24.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = cd2b51fe-3f5d-4f01-aae8-8398adb1aa4c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
65312024-12-21T07:51:24.608ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = cd2b51fe-3f5d-4f01-aae8-8398adb1aa4c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
65322024-12-21T07:51:24.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2507 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = cd2b51fe-3f5d-4f01-aae8-8398adb1aa4c response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
65332024-12-21T07:51:25.897ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1222 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = d5adccaf-ace0-4bd5-a0b8-3e3f73e7b353 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
65342024-12-21T07:51:33.506ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
65352024-12-21T07:51:33.506ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
65362024-12-21T07:51:33.506ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65372024-12-21T07:51:33.507ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65382024-12-21T07:51:33.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65392024-12-21T07:51:33.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65402024-12-21T07:51:33.508ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65412024-12-21T07:51:33.509ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65422024-12-21T07:51:33.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65432024-12-21T07:51:33.510ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.987928ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65442024-12-21T07:51:33.511ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65452024-12-21T07:51:33.511ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65462024-12-21T07:51:33.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65472024-12-21T07:51:33.513ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65482024-12-21T07:51:33.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65492024-12-21T07:51:33.514ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65502024-12-21T07:51:33.517ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
65512024-12-21T07:51:33.517ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65522024-12-21T07:51:33.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65532024-12-21T07:51:33.525ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
65542024-12-21T07:51:33.525ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.976636ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
65552024-12-21T07:51:35.897ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1148 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 0fecfabf-28e4-46e6-b3c3-c8cf2a0edeeb response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
65562024-12-21T07:51:43.507ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
65572024-12-21T07:51:43.507ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
65582024-12-21T07:51:43.507ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65592024-12-21T07:51:43.507ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65602024-12-21T07:51:43.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65612024-12-21T07:51:43.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65622024-12-21T07:51:43.510ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65632024-12-21T07:51:43.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65642024-12-21T07:51:43.510ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65652024-12-21T07:51:43.512ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.350952ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65662024-12-21T07:51:43.515ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65672024-12-21T07:51:43.515ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65682024-12-21T07:51:43.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65692024-12-21T07:51:43.517ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65702024-12-21T07:51:43.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65712024-12-21T07:51:43.518ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65722024-12-21T07:51:43.521ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
65732024-12-21T07:51:43.521ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65742024-12-21T07:51:43.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65752024-12-21T07:51:43.532ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
65762024-12-21T07:51:43.532ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.253594ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
65772024-12-21T07:51:45.897ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1189 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = b9dbaddf-4075-468f-b259-72e2889b35c3 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
65782024-12-21T07:51:50.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 6c838382-7eab-4348-ae81-065b8c2682c2 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
65792024-12-21T07:51:50.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 6c838382-7eab-4348-ae81-065b8c2682c2 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
65802024-12-21T07:51:50.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3319 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 6c838382-7eab-4348-ae81-065b8c2682c2 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
65812024-12-21T07:51:50.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = e139b496-af0f-44eb-af31-b934dcf00257 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
65822024-12-21T07:51:50.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = e139b496-af0f-44eb-af31-b934dcf00257 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
65832024-12-21T07:51:50.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2487 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = e139b496-af0f-44eb-af31-b934dcf00257 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
65842024-12-21T07:51:53.507ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
65852024-12-21T07:51:53.507ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
65862024-12-21T07:51:53.507ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
65872024-12-21T07:51:53.507ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
65882024-12-21T07:51:53.507ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65892024-12-21T07:51:53.507ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
65902024-12-21T07:51:53.507ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65912024-12-21T07:51:53.507ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
65922024-12-21T07:51:53.507ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
65932024-12-21T07:51:53.507ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
65942024-12-21T07:51:53.507ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65952024-12-21T07:51:53.507ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
65962024-12-21T07:51:53.507ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65972024-12-21T07:51:53.507ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
65982024-12-21T07:51:53.507ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
65992024-12-21T07:51:53.507ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66002024-12-21T07:51:53.507ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
66012024-12-21T07:51:53.507ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
66022024-12-21T07:51:53.507ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66032024-12-21T07:51:53.507ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
66042024-12-21T07:51:53.507ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66052024-12-21T07:51:53.507ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
66062024-12-21T07:51:53.507ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
66072024-12-21T07:51:53.507ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
66082024-12-21T07:51:53.507ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66092024-12-21T07:51:53.507ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
66102024-12-21T07:51:53.507ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
66112024-12-21T07:51:53.507ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66122024-12-21T07:51:53.507ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
66132024-12-21T07:51:53.507ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
66142024-12-21T07:51:53.507ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
66152024-12-21T07:51:53.507ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
66162024-12-21T07:51:53.507ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66172024-12-21T07:51:53.507ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
66182024-12-21T07:51:53.507ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
66192024-12-21T07:51:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66202024-12-21T07:51:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
66212024-12-21T07:51:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66222024-12-21T07:51:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
66232024-12-21T07:51:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66242024-12-21T07:51:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66252024-12-21T07:51:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66262024-12-21T07:51:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
66272024-12-21T07:51:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
66282024-12-21T07:51:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66292024-12-21T07:51:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66302024-12-21T07:51:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
66312024-12-21T07:51:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66322024-12-21T07:51:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
66332024-12-21T07:51:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66342024-12-21T07:51:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
66352024-12-21T07:51:53.510ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66362024-12-21T07:51:53.512ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66372024-12-21T07:51:53.514ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66382024-12-21T07:51:53.514ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
66392024-12-21T07:51:53.514ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66402024-12-21T07:51:53.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66412024-12-21T07:51:53.514ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66422024-12-21T07:51:53.514ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
66432024-12-21T07:51:53.514ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66442024-12-21T07:51:53.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66452024-12-21T07:51:53.515ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
66462024-12-21T07:51:53.515ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66472024-12-21T07:51:53.515ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66482024-12-21T07:51:53.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66492024-12-21T07:51:53.516ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66502024-12-21T07:51:53.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
66512024-12-21T07:51:53.516ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
66522024-12-21T07:51:53.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66532024-12-21T07:51:53.517ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 9.476862ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
66542024-12-21T07:51:53.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
66552024-12-21T07:51:53.518ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
66562024-12-21T07:51:53.518ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66572024-12-21T07:51:53.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66582024-12-21T07:51:53.521ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66592024-12-21T07:51:53.521ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66602024-12-21T07:51:53.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66612024-12-21T07:51:53.524ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66622024-12-21T07:51:53.524ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66632024-12-21T07:51:53.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66642024-12-21T07:51:53.525ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 17.925567ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
66652024-12-21T07:51:53.525ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1233, tv_nsec: 476251412 } })
66662024-12-21T07:51:53.525ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66672024-12-21T07:51:53.526ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
66682024-12-21T07:51:53.527ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66692024-12-21T07:51:53.527ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1233, tv_nsec: 478459480 } })
66702024-12-21T07:51:53.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66712024-12-21T07:51:53.528ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
66722024-12-21T07:51:53.528ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
66732024-12-21T07:51:53.528ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66742024-12-21T07:51:53.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66752024-12-21T07:51:53.532ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1233, tv_nsec: 483360714 } })
66762024-12-21T07:51:53.533ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
66772024-12-21T07:51:53.534ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66782024-12-21T07:51:53.534ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 27.257378ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66792024-12-21T07:51:53.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66802024-12-21T07:51:53.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66812024-12-21T07:51:53.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66822024-12-21T07:51:53.536ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66832024-12-21T07:51:53.538ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
66842024-12-21T07:51:53.538ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66852024-12-21T07:51:53.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66862024-12-21T07:51:53.567ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 59.624883ms iteration = 10 status = {"errors":[],"finish_invoked_ok":[]}
66872024-12-21T07:51:53.583ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66882024-12-21T07:51:53.583ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
66892024-12-21T07:51:53.583ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66902024-12-21T07:51:53.583ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
66912024-12-21T07:51:53.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66922024-12-21T07:51:53.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
66932024-12-21T07:51:53.585ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66942024-12-21T07:51:53.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
66952024-12-21T07:51:53.589ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66962024-12-21T07:51:53.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66972024-12-21T07:51:53.589ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66982024-12-21T07:51:53.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66992024-12-21T07:51:53.591ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
67002024-12-21T07:51:53.591ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 84.243945ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
67012024-12-21T07:51:53.594ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67022024-12-21T07:51:53.594ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67032024-12-21T07:51:53.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67042024-12-21T07:51:53.595ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67052024-12-21T07:51:53.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
67062024-12-21T07:51:53.596ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67072024-12-21T07:51:53.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67082024-12-21T07:51:53.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
67092024-12-21T07:51:53.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67102024-12-21T07:51:53.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67112024-12-21T07:51:53.616ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
67122024-12-21T07:51:53.616ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 108.715235ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
67132024-12-21T07:51:53.624ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
67142024-12-21T07:51:53.624ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67152024-12-21T07:51:53.624ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c1e2e05-474b-4a80-a190-e24bff0608a1", "content-length": "26", "date": "Sat, 21 Dec 2024 07:51:53 GMT"} })
67162024-12-21T07:51:53.624ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67172024-12-21T07:51:53.627ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
67182024-12-21T07:51:53.632ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67192024-12-21T07:51:53.632ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
67202024-12-21T07:51:53.632ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 125.027194ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
67212024-12-21T07:51:53.653ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67222024-12-21T07:51:53.655ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 148.001218ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
67232024-12-21T07:51:53.655ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
67242024-12-21T07:51:53.655ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67252024-12-21T07:51:53.656ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb8beb5d-fc88-4713-bd8a-87554da69e6d", "content-length": "26", "date": "Sat, 21 Dec 2024 07:51:53 GMT"} })
67262024-12-21T07:51:53.656ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67272024-12-21T07:51:53.656ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 148.861094ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
67282024-12-21T07:51:53.656ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
67292024-12-21T07:51:53.656ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67302024-12-21T07:51:53.657ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 149.82231ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
67312024-12-21T07:51:53.657ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
67322024-12-21T07:51:53.657ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67332024-12-21T07:51:53.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67342024-12-21T07:51:53.657ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6f04d7c-e3cb-4bcd-84fb-c1d4efbff6a2", "content-length": "26", "date": "Sat, 21 Dec 2024 07:51:53 GMT"} })
67352024-12-21T07:51:53.657ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
67362024-12-21T07:51:53.657ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67372024-12-21T07:51:53.659ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
67382024-12-21T07:51:53.660ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 152.970574ms iteration = 10 status = 0
67392024-12-21T07:51:53.667ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 160.528583ms iteration = 12 status = {"physical_disks_added":0}
67402024-12-21T07:51:53.696ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67412024-12-21T07:51:53.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67422024-12-21T07:51:53.739ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 231.552321ms iteration = 10 status = {}
67432024-12-21T07:51:53.749ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67442024-12-21T07:51:53.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67452024-12-21T07:51:53.763ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
67462024-12-21T07:51:53.763ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "23cdf796-2126-4441-983b-0a94fede0f6e", "content-length": "1", "date": "Sat, 21 Dec 2024 07:51:53 GMT"} })
67472024-12-21T07:51:53.765ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
67482024-12-21T07:51:53.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
67492024-12-21T07:51:53.767ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
67502024-12-21T07:51:53.767ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
67512024-12-21T07:51:53.767ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9168faa-65b5-424a-bae2-bfb0dbca53a5", "content-length": "372", "date": "Sat, 21 Dec 2024 07:51:53 GMT"} })
67522024-12-21T07:51:53.767ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67532024-12-21T07:51:53.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67542024-12-21T07:51:53.768ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67552024-12-21T07:51:53.769ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 261.756189ms iteration = 10 status = null
67562024-12-21T07:51:53.771ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67572024-12-21T07:51:53.771ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67582024-12-21T07:51:53.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67592024-12-21T07:51:53.773ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67602024-12-21T07:51:53.776ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67612024-12-21T07:51:53.776ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67622024-12-21T07:51:53.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67632024-12-21T07:51:53.783ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
67642024-12-21T07:51:53.783ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
67652024-12-21T07:51:53.784ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "8f29d1f3-93c2-4cf0-a78b-44d35f5a9fff", "date": "Sat, 21 Dec 2024 07:51:53 GMT"} })
67662024-12-21T07:51:53.784ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67672024-12-21T07:51:53.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67682024-12-21T07:51:53.786ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67692024-12-21T07:51:53.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67702024-12-21T07:51:53.790ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67712024-12-21T07:51:53.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67722024-12-21T07:51:53.795ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
67732024-12-21T07:51:53.795ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
67742024-12-21T07:51:53.796ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "cfbe120b-32fb-4e5f-995c-cb3ab926ec6f", "date": "Sat, 21 Dec 2024 07:51:53 GMT"} })
67752024-12-21T07:51:53.798ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 290.597484ms iteration = 11 status = {}
67762024-12-21T07:51:53.827ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
67772024-12-21T07:51:53.850ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67782024-12-21T07:51:53.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67792024-12-21T07:51:53.852ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
67802024-12-21T07:51:53.852ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67812024-12-21T07:51:53.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67822024-12-21T07:51:53.861ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
67832024-12-21T07:51:53.861ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "531ddc60-fd8f-4fc9-a774-990e8ea01cc9", "content-length": "134", "date": "Sat, 21 Dec 2024 07:51:53 GMT"} })
67842024-12-21T07:51:53.861ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
67852024-12-21T07:51:53.861ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
67862024-12-21T07:51:53.861ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
67872024-12-21T07:51:53.861ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
67882024-12-21T07:51:53.861ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67892024-12-21T07:51:53.861ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67902024-12-21T07:51:53.861ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67912024-12-21T07:51:53.861ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
67922024-12-21T07:51:53.861ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67932024-12-21T07:51:53.862ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
67942024-12-21T07:51:53.862ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
67952024-12-21T07:51:53.862ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67962024-12-21T07:51:53.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67972024-12-21T07:51:53.864ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
67982024-12-21T07:51:53.864ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e56045e-fba5-4315-9339-acc2408d5e60", "content-length": "2", "date": "Sat, 21 Dec 2024 07:51:53 GMT"} })
67992024-12-21T07:51:53.864ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
68002024-12-21T07:51:53.864ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "86800367-56d5-4b28-823d-21cb503b93cc", "content-length": "52", "date": "Sat, 21 Dec 2024 07:51:53 GMT"} })
68012024-12-21T07:51:53.864ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
68022024-12-21T07:51:53.864ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
68032024-12-21T07:51:53.926ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "113b3588-4934-41bf-ae93-878b428ecf09", "content-length": "691", "date": "Sat, 21 Dec 2024 07:51:53 GMT"} })
68042024-12-21T07:51:53.926ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
68052024-12-21T07:51:53.926ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
68062024-12-21T07:51:53.926ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
68072024-12-21T07:51:53.928ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 420.722306ms iteration = 10 status = {}
68082024-12-21T07:51:54.018ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "899124fd-036f-4edf-9f0d-9c40c8c7e03d", "date": "Sat, 21 Dec 2024 07:51:53 GMT"} })
68092024-12-21T07:51:54.018ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
68102024-12-21T07:51:54.018ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
68112024-12-21T07:51:54.023ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d6c7197-d059-4dfb-ba9f-211b71e6499f", "content-length": "682", "date": "Sat, 21 Dec 2024 07:51:53 GMT"} })
68122024-12-21T07:51:54.023ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68132024-12-21T07:51:54.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68142024-12-21T07:51:54.026ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68152024-12-21T07:51:54.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68162024-12-21T07:51:54.029ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68172024-12-21T07:51:54.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68182024-12-21T07:51:54.030ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68192024-12-21T07:51:54.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68202024-12-21T07:51:54.038ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 530.871925ms iteration = 10 status = {}
68212024-12-21T07:51:54.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 5027cdc9-b1a3-4d43-a729-1008735edba5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
68222024-12-21T07:51:54.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 5027cdc9-b1a3-4d43-a729-1008735edba5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
68232024-12-21T07:51:54.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2518 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 5027cdc9-b1a3-4d43-a729-1008735edba5 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
68242024-12-21T07:51:55.897ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1137 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 4fea8e73-a612-4ae7-8b2a-7a07934c4e07 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
68252024-12-21T07:52:03.507ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
68262024-12-21T07:52:03.507ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
68272024-12-21T07:52:03.507ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68282024-12-21T07:52:03.507ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68292024-12-21T07:52:03.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68302024-12-21T07:52:03.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68312024-12-21T07:52:03.509ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68322024-12-21T07:52:03.511ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68332024-12-21T07:52:03.511ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68342024-12-21T07:52:03.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68352024-12-21T07:52:03.514ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68362024-12-21T07:52:03.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68372024-12-21T07:52:03.516ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68382024-12-21T07:52:03.518ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
68392024-12-21T07:52:03.518ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68402024-12-21T07:52:03.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68412024-12-21T07:52:03.530ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
68422024-12-21T07:52:03.530ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.139227ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
68432024-12-21T07:52:03.536ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68442024-12-21T07:52:03.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68452024-12-21T07:52:03.564ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.450686ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68462024-12-21T07:52:05.897ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1160 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 91a9eb17-5e77-47dd-8ccf-783ffeb846ea response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
68472024-12-21T07:52:13.507ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
68482024-12-21T07:52:13.507ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
68492024-12-21T07:52:13.507ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68502024-12-21T07:52:13.507ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68512024-12-21T07:52:13.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68522024-12-21T07:52:13.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68532024-12-21T07:52:13.509ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68542024-12-21T07:52:13.509ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68552024-12-21T07:52:13.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68562024-12-21T07:52:13.511ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.944428ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68572024-12-21T07:52:13.511ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68582024-12-21T07:52:13.511ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68592024-12-21T07:52:13.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68602024-12-21T07:52:13.513ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68612024-12-21T07:52:13.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68622024-12-21T07:52:13.514ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68632024-12-21T07:52:13.517ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
68642024-12-21T07:52:13.517ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68652024-12-21T07:52:13.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68662024-12-21T07:52:13.525ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
68672024-12-21T07:52:13.525ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.344105ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
68682024-12-21T07:52:15.898ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1112 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = ad68d8a2-e205-4a96-b280-415c4531d718 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
68692024-12-21T07:52:20.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 959d9cee-f485-49e8-babc-0853e164eeca roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
68702024-12-21T07:52:20.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 959d9cee-f485-49e8-babc-0853e164eeca resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
68712024-12-21T07:52:20.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2841 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 959d9cee-f485-49e8-babc-0853e164eeca response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
68722024-12-21T07:52:20.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = acd1fcba-abb1-4110-b9d9-56aca81cfea1 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
68732024-12-21T07:52:20.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = acd1fcba-abb1-4110-b9d9-56aca81cfea1 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
68742024-12-21T07:52:20.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2419 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = acd1fcba-abb1-4110-b9d9-56aca81cfea1 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
68752024-12-21T07:52:23.506ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
68762024-12-21T07:52:23.506ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
68772024-12-21T07:52:23.506ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68782024-12-21T07:52:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68792024-12-21T07:52:23.507ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
68802024-12-21T07:52:23.507ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
68812024-12-21T07:52:23.507ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
68822024-12-21T07:52:23.507ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
68832024-12-21T07:52:23.507ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
68842024-12-21T07:52:23.507ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
68852024-12-21T07:52:23.507ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
68862024-12-21T07:52:23.507ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68872024-12-21T07:52:23.507ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68882024-12-21T07:52:23.507ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
68892024-12-21T07:52:23.507ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68902024-12-21T07:52:23.507ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
68912024-12-21T07:52:23.507ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
68922024-12-21T07:52:23.507ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
68932024-12-21T07:52:23.507ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68942024-12-21T07:52:23.507ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
68952024-12-21T07:52:23.507ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
68962024-12-21T07:52:23.507ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68972024-12-21T07:52:23.507ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
68982024-12-21T07:52:23.507ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68992024-12-21T07:52:23.507ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
69002024-12-21T07:52:23.507ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
69012024-12-21T07:52:23.507ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69022024-12-21T07:52:23.507ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
69032024-12-21T07:52:23.507ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
69042024-12-21T07:52:23.507ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
69052024-12-21T07:52:23.507ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69062024-12-21T07:52:23.507ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
69072024-12-21T07:52:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
69082024-12-21T07:52:23.507ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
69092024-12-21T07:52:23.507ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
69102024-12-21T07:52:23.507ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
69112024-12-21T07:52:23.507ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69122024-12-21T07:52:23.507ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
69132024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
69142024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69152024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
69162024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
69172024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
69182024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
69192024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
69202024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
69212024-12-21T07:52:23.508ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:42:23.507353138 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
69222024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
69232024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
69242024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
69252024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
69262024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
69272024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
69282024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
69292024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
69302024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
69312024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
69322024-12-21T07:52:23.508ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
69332024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69342024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
69352024-12-21T07:52:23.508ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 3f45718f-9869-448a-a087-788e66db5e9d
69362024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
69372024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
69382024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.501\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"3f45718f-9869-448a-a087-788e66db5e9d"}
69392024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
69402024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
69412024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
69422024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69432024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69442024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
69452024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69462024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69472024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69482024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69492024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69502024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
69512024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69522024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
69532024-12-21T07:52:23.508ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1595c632-cfae-4f6b-937d-d413dd8cf0b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1263, tv_nsec: 458275843 } })
69542024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69552024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
69562024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69572024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
69582024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
69592024-12-21T07:52:23.508ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("481de7e8-0737-474b-8c33-e6e8bc6477be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("683a9892-43cd-4dd8-a983-26cccd988df0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1263, tv_nsec: 458429436 } })
69602024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
69612024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
69622024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69632024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
69642024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
69652024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
69662024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
69672024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
69682024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69692024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
69702024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.061988ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
69712024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
69722024-12-21T07:52:23.508ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.094609ms iteration = 7 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
69732024-12-21T07:52:23.516ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69742024-12-21T07:52:23.520ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69752024-12-21T07:52:23.520ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69762024-12-21T07:52:23.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69772024-12-21T07:52:23.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69782024-12-21T07:52:23.521ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69792024-12-21T07:52:23.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69802024-12-21T07:52:23.521ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
69812024-12-21T07:52:23.521ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69822024-12-21T07:52:23.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69832024-12-21T07:52:23.522ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 14.823134ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
69842024-12-21T07:52:23.523ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69852024-12-21T07:52:23.523ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69862024-12-21T07:52:23.524ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69872024-12-21T07:52:23.525ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69882024-12-21T07:52:23.525ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 18.228892ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
69892024-12-21T07:52:23.526ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
69902024-12-21T07:52:23.526ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69912024-12-21T07:52:23.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69922024-12-21T07:52:23.527ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
69932024-12-21T07:52:23.527ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69942024-12-21T07:52:23.527ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
69952024-12-21T07:52:23.527ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69962024-12-21T07:52:23.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69972024-12-21T07:52:23.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69982024-12-21T07:52:23.528ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
69992024-12-21T07:52:23.528ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
70002024-12-21T07:52:23.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
70012024-12-21T07:52:23.529ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70022024-12-21T07:52:23.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70032024-12-21T07:52:23.533ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1263, tv_nsec: 482763123 } })
70042024-12-21T07:52:23.533ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
70052024-12-21T07:52:23.533ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
70062024-12-21T07:52:23.533ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
70072024-12-21T07:52:23.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
70082024-12-21T07:52:23.534ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 26.090147ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
70092024-12-21T07:52:23.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70102024-12-21T07:52:23.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70112024-12-21T07:52:23.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70122024-12-21T07:52:23.538ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70132024-12-21T07:52:23.540ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:42:23.507353138 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
70142024-12-21T07:52:23.540ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 33.22963ms iteration = 6 status = {"expiration":"2024-12-21T07:42:23.507353138Z","pruned":[]}
70152024-12-21T07:52:23.541ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
70162024-12-21T07:52:23.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
70172024-12-21T07:52:23.541ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1263, tv_nsec: 492180665 } })
70182024-12-21T07:52:23.541ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
70192024-12-21T07:52:23.542ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70202024-12-21T07:52:23.542ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
70212024-12-21T07:52:23.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70222024-12-21T07:52:23.543ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70232024-12-21T07:52:23.544ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70242024-12-21T07:52:23.545ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70252024-12-21T07:52:23.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70262024-12-21T07:52:23.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
70272024-12-21T07:52:23.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
70282024-12-21T07:52:23.550ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70292024-12-21T07:52:23.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70302024-12-21T07:52:23.552ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 44.963661ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70312024-12-21T07:52:23.553ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70322024-12-21T07:52:23.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70332024-12-21T07:52:23.559ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70342024-12-21T07:52:23.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70352024-12-21T07:52:23.560ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70362024-12-21T07:52:23.560ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1263, tv_nsec: 511010218 } })
70372024-12-21T07:52:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70382024-12-21T07:52:23.561ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
70392024-12-21T07:52:23.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70402024-12-21T07:52:23.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70412024-12-21T07:52:23.563ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70422024-12-21T07:52:23.564ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 56.997928ms iteration = 11 status = {"errors":[],"finish_invoked_ok":[]}
70432024-12-21T07:52:23.564ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70442024-12-21T07:52:23.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70452024-12-21T07:52:23.565ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
70462024-12-21T07:52:23.565ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 58.147058ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
70472024-12-21T07:52:23.565ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
70482024-12-21T07:52:23.565ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70492024-12-21T07:52:23.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70502024-12-21T07:52:23.573ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70512024-12-21T07:52:23.573ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70522024-12-21T07:52:23.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70532024-12-21T07:52:23.574ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70542024-12-21T07:52:23.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70552024-12-21T07:52:23.575ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70562024-12-21T07:52:23.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70572024-12-21T07:52:23.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
70582024-12-21T07:52:23.578ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70592024-12-21T07:52:23.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70602024-12-21T07:52:23.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70612024-12-21T07:52:23.579ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70622024-12-21T07:52:23.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70632024-12-21T07:52:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
70642024-12-21T07:52:23.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70652024-12-21T07:52:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70662024-12-21T07:52:23.582ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70672024-12-21T07:52:23.582ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70682024-12-21T07:52:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70692024-12-21T07:52:23.585ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
70702024-12-21T07:52:23.585ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70712024-12-21T07:52:23.585ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70722024-12-21T07:52:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70732024-12-21T07:52:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70742024-12-21T07:52:23.589ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70752024-12-21T07:52:23.597ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
70762024-12-21T07:52:23.597ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70772024-12-21T07:52:23.597ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70782024-12-21T07:52:23.597ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
70792024-12-21T07:52:23.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70802024-12-21T07:52:23.597ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70812024-12-21T07:52:23.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70822024-12-21T07:52:23.602ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70832024-12-21T07:52:23.602ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70842024-12-21T07:52:23.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70852024-12-21T07:52:23.604ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70862024-12-21T07:52:23.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
70872024-12-21T07:52:23.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70882024-12-21T07:52:23.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
70892024-12-21T07:52:23.605ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
70902024-12-21T07:52:23.605ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70912024-12-21T07:52:23.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70922024-12-21T07:52:23.606ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70932024-12-21T07:52:23.611ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
70942024-12-21T07:52:23.611ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
70952024-12-21T07:52:23.611ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
70962024-12-21T07:52:23.611ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70972024-12-21T07:52:23.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70982024-12-21T07:52:23.612ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70992024-12-21T07:52:23.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71002024-12-21T07:52:23.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
71012024-12-21T07:52:23.613ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71022024-12-21T07:52:23.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71032024-12-21T07:52:23.614ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
71042024-12-21T07:52:23.614ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
71052024-12-21T07:52:23.614ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 106.519507ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
71062024-12-21T07:52:23.615ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 108.38595ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
71072024-12-21T07:52:23.616ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71082024-12-21T07:52:23.617ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71092024-12-21T07:52:23.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71102024-12-21T07:52:23.618ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
71112024-12-21T07:52:23.618ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
71122024-12-21T07:52:23.618ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
71132024-12-21T07:52:23.618ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71142024-12-21T07:52:23.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71152024-12-21T07:52:23.621ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71162024-12-21T07:52:23.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71172024-12-21T07:52:23.622ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
71182024-12-21T07:52:23.622ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 114.87975ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
71192024-12-21T07:52:23.622ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
71202024-12-21T07:52:23.622ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 115.192185ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
71212024-12-21T07:52:23.623ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
71222024-12-21T07:52:23.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
71232024-12-21T07:52:23.623ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71242024-12-21T07:52:23.623ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 116.152482ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
71252024-12-21T07:52:23.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71262024-12-21T07:52:23.652ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71272024-12-21T07:52:23.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71282024-12-21T07:52:23.653ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71292024-12-21T07:52:23.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71302024-12-21T07:52:23.674ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
71312024-12-21T07:52:23.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
71322024-12-21T07:52:23.682ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71332024-12-21T07:52:23.682ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
71342024-12-21T07:52:23.682ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71352024-12-21T07:52:23.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71362024-12-21T07:52:23.740ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
71372024-12-21T07:52:23.759ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 251.747969ms iteration = 13 status = {"physical_disks_added":0}
71382024-12-21T07:52:23.767ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
71392024-12-21T07:52:23.767ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71402024-12-21T07:52:23.768ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe4f820b-3f1d-4f35-b10a-6b8d3953830b", "content-length": "26", "date": "Sat, 21 Dec 2024 07:52:23 GMT"} })
71412024-12-21T07:52:23.768ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71422024-12-21T07:52:23.770ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
71432024-12-21T07:52:23.787ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
71442024-12-21T07:52:23.787ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71452024-12-21T07:52:23.787ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d363f9c0-8c5d-43a4-b5fd-1ef4173fac5f", "content-length": "26", "date": "Sat, 21 Dec 2024 07:52:23 GMT"} })
71462024-12-21T07:52:23.787ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71472024-12-21T07:52:23.789ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
71482024-12-21T07:52:23.807ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
71492024-12-21T07:52:23.807ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71502024-12-21T07:52:23.807ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "88999bd1-a5a0-4c47-a90e-39ffcc5af5a8", "content-length": "26", "date": "Sat, 21 Dec 2024 07:52:23 GMT"} })
71512024-12-21T07:52:23.807ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71522024-12-21T07:52:23.808ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
71532024-12-21T07:52:23.827ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
71542024-12-21T07:52:23.844ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
71552024-12-21T07:52:23.844ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d0b778a2-12c9-4a6c-8e3e-2960b91a1509", "content-length": "691", "date": "Sat, 21 Dec 2024 07:52:23 GMT"} })
71562024-12-21T07:52:23.844ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
71572024-12-21T07:52:23.844ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
71582024-12-21T07:52:23.844ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
71592024-12-21T07:52:23.846ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71602024-12-21T07:52:23.846ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 338.920933ms iteration = 11 status = {}
71612024-12-21T07:52:23.846ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71622024-12-21T07:52:23.848ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71632024-12-21T07:52:23.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71642024-12-21T07:52:23.848ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
71652024-12-21T07:52:23.848ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 0 version = 2
71662024-12-21T07:52:23.848ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71672024-12-21T07:52:23.848ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 341.489987ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
71682024-12-21T07:52:23.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71692024-12-21T07:52:23.849ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71702024-12-21T07:52:23.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
71712024-12-21T07:52:23.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71722024-12-21T07:52:23.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
71732024-12-21T07:52:23.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71742024-12-21T07:52:23.851ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71752024-12-21T07:52:23.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71762024-12-21T07:52:23.852ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
71772024-12-21T07:52:23.852ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71782024-12-21T07:52:23.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71792024-12-21T07:52:23.855ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71802024-12-21T07:52:23.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71812024-12-21T07:52:23.856ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 348.902744ms iteration = 11 status = 0
71822024-12-21T07:52:23.857ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71832024-12-21T07:52:23.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71842024-12-21T07:52:23.892ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71852024-12-21T07:52:23.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71862024-12-21T07:52:23.894ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71872024-12-21T07:52:23.894ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
71882024-12-21T07:52:23.894ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 387.338784ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
71892024-12-21T07:52:23.894ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71902024-12-21T07:52:23.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71912024-12-21T07:52:23.896ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71922024-12-21T07:52:23.896ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
71932024-12-21T07:52:23.896ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
71942024-12-21T07:52:23.896ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71952024-12-21T07:52:23.896ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71962024-12-21T07:52:23.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71972024-12-21T07:52:23.898ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71982024-12-21T07:52:23.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
71992024-12-21T07:52:23.900ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72002024-12-21T07:52:23.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72012024-12-21T07:52:23.901ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
72022024-12-21T07:52:23.901ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72032024-12-21T07:52:23.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
72042024-12-21T07:52:23.902ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
72052024-12-21T07:52:23.902ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72062024-12-21T07:52:23.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72072024-12-21T07:52:23.902ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72082024-12-21T07:52:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72092024-12-21T07:52:23.903ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 1 version = 2
72102024-12-21T07:52:23.903ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
72112024-12-21T07:52:23.903ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 07:47:25.290148 UTC dns_group = external generation = 2
72122024-12-21T07:52:23.903ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 396.336798ms iteration = 7 status = {"generation":2}
72132024-12-21T07:52:23.904ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:47:21.583817Z, time_modified: 2024-12-21T07:47:21.583817Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }) }
72142024-12-21T07:52:23.904ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 396.871427ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]}},"default_endpoint":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
72152024-12-21T07:52:23.905ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
72162024-12-21T07:52:23.905ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
72172024-12-21T07:52:23.905ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 07:47:23.936594 UTC dns_group = internal generation = 1
72182024-12-21T07:52:23.905ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 398.562096ms iteration = 7 status = {"generation":1}
72192024-12-21T07:52:23.906ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72202024-12-21T07:52:23.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72212024-12-21T07:52:23.909ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72222024-12-21T07:52:23.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72232024-12-21T07:52:23.912ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72242024-12-21T07:52:23.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72252024-12-21T07:52:23.913ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72262024-12-21T07:52:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72272024-12-21T07:52:23.914ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
72282024-12-21T07:52:23.914ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
72292024-12-21T07:52:23.914ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7334111-d921-4bf3-98f7-d447e53d69a7", "content-length": "372", "date": "Sat, 21 Dec 2024 07:52:23 GMT"} })
72302024-12-21T07:52:23.914ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72312024-12-21T07:52:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72322024-12-21T07:52:23.915ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72332024-12-21T07:52:23.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72342024-12-21T07:52:23.917ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72352024-12-21T07:52:23.920ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
72362024-12-21T07:52:23.920ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72372024-12-21T07:52:23.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72382024-12-21T07:52:23.921ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72392024-12-21T07:52:23.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72402024-12-21T07:52:23.923ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72412024-12-21T07:52:23.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72422024-12-21T07:52:23.937ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
72432024-12-21T07:52:23.937ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 429.723931ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
72442024-12-21T07:52:23.971ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72452024-12-21T07:52:23.974ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
72462024-12-21T07:52:23.975ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72472024-12-21T07:52:23.975ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
72482024-12-21T07:52:23.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72492024-12-21T07:52:23.975ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
72502024-12-21T07:52:23.975ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f19ba216-6491-4179-b135-4dc41cbb99cb", "date": "Sat, 21 Dec 2024 07:52:23 GMT"} })
72512024-12-21T07:52:23.975ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72522024-12-21T07:52:23.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72532024-12-21T07:52:23.978ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72542024-12-21T07:52:23.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72552024-12-21T07:52:23.982ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72562024-12-21T07:52:23.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72572024-12-21T07:52:23.983ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72582024-12-21T07:52:23.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72592024-12-21T07:52:23.984ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72602024-12-21T07:52:23.984ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
72612024-12-21T07:52:23.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72622024-12-21T07:52:23.985ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f5371d0-28a9-4394-a78f-f9edc7811c4e", "content-length": "1", "date": "Sat, 21 Dec 2024 07:52:23 GMT"} })
72632024-12-21T07:52:23.985ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
72642024-12-21T07:52:23.985ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
72652024-12-21T07:52:23.986ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
72662024-12-21T07:52:23.986ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4d386002-9292-40d9-bc39-3b34bc1ba0a3", "date": "Sat, 21 Dec 2024 07:52:23 GMT"} })
72672024-12-21T07:52:23.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
72682024-12-21T07:52:23.986ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72692024-12-21T07:52:23.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72702024-12-21T07:52:23.988ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 480.789646ms iteration = 12 status = {}
72712024-12-21T07:52:23.988ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 480.886617ms iteration = 11 status = null
72722024-12-21T07:52:23.988ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72732024-12-21T07:52:23.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72742024-12-21T07:52:23.994ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72752024-12-21T07:52:23.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72762024-12-21T07:52:23.996ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72772024-12-21T07:52:23.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72782024-12-21T07:52:24.027ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72792024-12-21T07:52:24.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72802024-12-21T07:52:24.028ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72812024-12-21T07:52:24.032ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
72822024-12-21T07:52:24.032ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72832024-12-21T07:52:24.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72842024-12-21T07:52:24.034ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72852024-12-21T07:52:24.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72862024-12-21T07:52:24.035ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72872024-12-21T07:52:24.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72882024-12-21T07:52:24.036ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72892024-12-21T07:52:24.040ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
72902024-12-21T07:52:24.040ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72912024-12-21T07:52:24.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72922024-12-21T07:52:24.045ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 95e048ed-0de5-4c3b-a368-18ddaf75c49e, kind: Service { id: 8fbd6070-9acd-409b-bda8-dadf2a05b00e }, name: Name("nexus-8fbd6070-9acd-409b-bda8-dadf2a05b00e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9b744bef-fce0-46ab-93b4-a179a1aaa5aa, kind: Service { id: 4b205886-0970-4a9e-bff0-ae1192504434 }, name: Name("nexus-4b205886-0970-4a9e-bff0-ae1192504434"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c592275e-d41b-414d-af17-bfadf96c8a68, kind: Service { id: 428cd3f9-eecf-4305-9c0b-1698df6403fd }, name: Name("nexus-428cd3f9-eecf-4305-9c0b-1698df6403fd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 528044ef-9437-43f9-b92d-7d435209bb68, kind: Service { id: e6b54c38-8771-4091-8fc3-2bbdae94bd35 }, name: Name("external-dns-e6b54c38-8771-4091-8fc3-2bbdae94bd35"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 45])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6b349cca-d953-4887-a151-4eb9ed8779f4, kind: Service { id: 1595c632-cfae-4f6b-937d-d413dd8cf0b7 }, name: Name("external-dns-1595c632-cfae-4f6b-937d-d413dd8cf0b7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
72932024-12-21T07:52:24.045ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72942024-12-21T07:52:24.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72952024-12-21T07:52:24.047ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72962024-12-21T07:52:24.049ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
72972024-12-21T07:52:24.049ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72982024-12-21T07:52:24.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72992024-12-21T07:52:24.050ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
73002024-12-21T07:52:24.050ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 528044ef-9437-43f9-b92d-7d435209bb68, kind: Service { id: e6b54c38-8771-4091-8fc3-2bbdae94bd35 }, name: Name("external-dns-e6b54c38-8771-4091-8fc3-2bbdae94bd35"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 45])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6b349cca-d953-4887-a151-4eb9ed8779f4, kind: Service { id: 1595c632-cfae-4f6b-937d-d413dd8cf0b7 }, name: Name("external-dns-1595c632-cfae-4f6b-937d-d413dd8cf0b7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 95e048ed-0de5-4c3b-a368-18ddaf75c49e, kind: Service { id: 8fbd6070-9acd-409b-bda8-dadf2a05b00e }, name: Name("nexus-8fbd6070-9acd-409b-bda8-dadf2a05b00e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9b744bef-fce0-46ab-93b4-a179a1aaa5aa, kind: Service { id: 4b205886-0970-4a9e-bff0-ae1192504434 }, name: Name("nexus-4b205886-0970-4a9e-bff0-ae1192504434"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c592275e-d41b-414d-af17-bfadf96c8a68, kind: Service { id: 428cd3f9-eecf-4305-9c0b-1698df6403fd }, name: Name("nexus-428cd3f9-eecf-4305-9c0b-1698df6403fd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
73012024-12-21T07:52:24.050ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
73022024-12-21T07:52:24.054ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 547.284567ms iteration = 11 status = {}
73032024-12-21T07:52:24.056ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
73042024-12-21T07:52:24.056ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "944d81bd-7ba5-498d-a5ee-a034bcdcc2ae", "date": "Sat, 21 Dec 2024 07:52:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
73052024-12-21T07:52:24.056ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
73062024-12-21T07:52:24.058ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "f6a0e7e1-c23a-4dd2-9519-82951332f9eb", "date": "Sat, 21 Dec 2024 07:52:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
73072024-12-21T07:52:24.058ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
73082024-12-21T07:52:24.060ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
73092024-12-21T07:52:24.060ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 553.345141ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
73102024-12-21T07:52:24.070ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
73112024-12-21T07:52:24.140ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
73122024-12-21T07:52:24.141ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "a8a6d7b2-674c-467d-a163-af470f40e4c0", "date": "Sat, 21 Dec 2024 07:52:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
73132024-12-21T07:52:24.141ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
73142024-12-21T07:52:24.143ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "7d5996af-262b-42c4-8511-66c746834dbf", "date": "Sat, 21 Dec 2024 07:52:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
73152024-12-21T07:52:24.143ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
73162024-12-21T07:52:24.145ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "26117987-7dc2-43a3-a72f-c15540df84b2", "date": "Sat, 21 Dec 2024 07:52:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
73172024-12-21T07:52:24.145ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
73182024-12-21T07:52:24.147ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
73192024-12-21T07:52:24.147ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 640.310352ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
73202024-12-21T07:52:24.166ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73212024-12-21T07:52:24.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73222024-12-21T07:52:24.166ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: c992e3dc-2d80-4655-85d0-78e9a80bf69e, time_created: 2024-12-21T07:47:23.178624Z, time_modified: 2024-12-21T07:47:23.178624Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
73232024-12-21T07:52:24.166ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
73242024-12-21T07:52:24.166ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73252024-12-21T07:52:24.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73262024-12-21T07:52:24.168ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
73272024-12-21T07:52:24.168ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73282024-12-21T07:52:24.169ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73292024-12-21T07:52:24.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73302024-12-21T07:52:24.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73312024-12-21T07:52:24.171ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73322024-12-21T07:52:24.173ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
73332024-12-21T07:52:24.180ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
73342024-12-21T07:52:24.180ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2b260b4-5e44-4c94-bc78-dd04bce9613c", "content-length": "134", "date": "Sat, 21 Dec 2024 07:52:23 GMT"} })
73352024-12-21T07:52:24.180ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
73362024-12-21T07:52:24.180ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
73372024-12-21T07:52:24.180ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
73382024-12-21T07:52:24.180ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
73392024-12-21T07:52:24.180ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73402024-12-21T07:52:24.180ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73412024-12-21T07:52:24.180ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73422024-12-21T07:52:24.180ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
73432024-12-21T07:52:24.180ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73442024-12-21T07:52:24.180ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
73452024-12-21T07:52:24.181ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
73462024-12-21T07:52:24.181ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73472024-12-21T07:52:24.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73482024-12-21T07:52:24.182ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
73492024-12-21T07:52:24.182ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ac525c3-95e0-41cc-a1ec-accc52724521", "content-length": "2", "date": "Sat, 21 Dec 2024 07:52:23 GMT"} })
73502024-12-21T07:52:24.182ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
73512024-12-21T07:52:24.182ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "deafcf3e-77c5-45cc-9be4-265425960d94", "content-length": "52", "date": "Sat, 21 Dec 2024 07:52:23 GMT"} })
73522024-12-21T07:52:24.182ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
73532024-12-21T07:52:24.182ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
73542024-12-21T07:52:24.204ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
73552024-12-21T07:52:24.232ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "a2472d58-c16f-4441-8c22-8b5f80cbc3fb", "date": "Sat, 21 Dec 2024 07:52:24 GMT"} })
73562024-12-21T07:52:24.235ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
73572024-12-21T07:52:24.235ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 727.946085ms
73582024-12-21T07:52:24.235ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 727.957966ms iteration = 2 status = {}
73592024-12-21T07:52:24.320ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "21307ef4-e4eb-4105-a7e8-13a34bf3b56c", "date": "Sat, 21 Dec 2024 07:52:24 GMT"} })
73602024-12-21T07:52:24.320ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
73612024-12-21T07:52:24.320ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
73622024-12-21T07:52:24.325ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "64435518-1ec0-4fa2-95fb-4b7084809709", "content-length": "682", "date": "Sat, 21 Dec 2024 07:52:23 GMT"} })
73632024-12-21T07:52:24.325ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73642024-12-21T07:52:24.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73652024-12-21T07:52:24.329ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73662024-12-21T07:52:24.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73672024-12-21T07:52:24.333ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73682024-12-21T07:52:24.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73692024-12-21T07:52:24.335ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73702024-12-21T07:52:24.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73712024-12-21T07:52:24.342ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 835.732024ms iteration = 11 status = {}
73722024-12-21T07:52:24.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 2c420533-8877-4dec-bc78-3c7acab7498c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
73732024-12-21T07:52:24.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 2c420533-8877-4dec-bc78-3c7acab7498c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
73742024-12-21T07:52:24.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3352 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 2c420533-8877-4dec-bc78-3c7acab7498c response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
73752024-12-21T07:52:25.897ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1178 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = ed8aea9c-111f-4807-9e7e-578e7a23b4cf response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
73762024-12-21T07:52:26.139ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:34020
73772024-12-21T07:52:26.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34020 req_id = 0f6ef935-0222-4e49-964c-f735c6a9e9f5 roles = RoleSet { roles: {} } uri = /metrics/producers
73782024-12-21T07:52:26.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34020 req_id = 0f6ef935-0222-4e49-964c-f735c6a9e9f5 resource = Database result = Ok(()) uri = /metrics/producers
73792024-12-21T07:52:26.174ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = b2e6180f-2896-4592-b155-f5ca3f904fa7
73802024-12-21T07:52:26.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35188 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34020 req_id = 0f6ef935-0222-4e49-964c-f735c6a9e9f5 response_code = 201 uri = /metrics/producers
73812024-12-21T07:52:26.311ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
73822024-12-21T07:52:26.311ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
73832024-12-21T07:52:26.341ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
73842024-12-21T07:52:26.341ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:54094
73852024-12-21T07:52:26.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:54094 req_id = 185c2252-2a8a-48dc-8b40-cdb9247a9115 roles = RoleSet { roles: {} } uri = /metrics/producers
73862024-12-21T07:52:26.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:54094 req_id = 185c2252-2a8a-48dc-8b40-cdb9247a9115 resource = Database result = Ok(()) uri = /metrics/producers
73872024-12-21T07:52:26.383ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
73882024-12-21T07:52:26.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41822 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:54094 req_id = 185c2252-2a8a-48dc-8b40-cdb9247a9115 response_code = 201 uri = /metrics/producers
73892024-12-21T07:52:26.383ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "185c2252-2a8a-48dc-8b40-cdb9247a9115", "content-length": "41", "date": "Sat, 21 Dec 2024 07:52:26 GMT"} })
73902024-12-21T07:52:26.385ZDEBGnexus (producer-registration-task): registered with nexus successfully
73912024-12-21T07:52:26.385ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
73922024-12-21T07:52:33.507ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
73932024-12-21T07:52:33.507ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
73942024-12-21T07:52:33.507ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73952024-12-21T07:52:33.507ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73962024-12-21T07:52:33.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73972024-12-21T07:52:33.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73982024-12-21T07:52:33.509ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73992024-12-21T07:52:33.512ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74002024-12-21T07:52:33.512ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74012024-12-21T07:52:33.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74022024-12-21T07:52:33.514ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74032024-12-21T07:52:33.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74042024-12-21T07:52:33.516ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74052024-12-21T07:52:33.519ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
74062024-12-21T07:52:33.519ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74072024-12-21T07:52:33.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74082024-12-21T07:52:33.531ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
74092024-12-21T07:52:33.531ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.438153ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
74102024-12-21T07:52:33.537ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74112024-12-21T07:52:33.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74122024-12-21T07:52:33.565ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.789841ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74132024-12-21T07:52:35.898ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1644 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 5b3d6004-00ce-40cd-ab25-1e71c75ed8fb response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
74142024-12-21T07:52:40.932ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:58597
74152024-12-21T07:52:40.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58597 req_id = 7cb5b42a-d46a-4116-b0f0-c3299b51e116 roles = RoleSet { roles: {} } uri = /metrics/producers
74162024-12-21T07:52:40.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58597 req_id = 7cb5b42a-d46a-4116-b0f0-c3299b51e116 resource = Database result = Ok(()) uri = /metrics/producers
74172024-12-21T07:52:40.980ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = 42bd0fec-23e2-48f9-bdad-7989f94730a0
74182024-12-21T07:52:40.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47603 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58597 req_id = 7cb5b42a-d46a-4116-b0f0-c3299b51e116 response_code = 201 uri = /metrics/producers
74192024-12-21T07:52:43.508ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
74202024-12-21T07:52:43.508ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
74212024-12-21T07:52:43.508ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74222024-12-21T07:52:43.508ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74232024-12-21T07:52:43.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74242024-12-21T07:52:43.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74252024-12-21T07:52:43.510ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74262024-12-21T07:52:43.512ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74272024-12-21T07:52:43.512ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74282024-12-21T07:52:43.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74292024-12-21T07:52:43.514ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74302024-12-21T07:52:43.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74312024-12-21T07:52:43.516ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74322024-12-21T07:52:43.518ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
74332024-12-21T07:52:43.518ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74342024-12-21T07:52:43.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74352024-12-21T07:52:43.529ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
74362024-12-21T07:52:43.529ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.177883ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
74372024-12-21T07:52:43.537ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74382024-12-21T07:52:43.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74392024-12-21T07:52:43.538ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.725647ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74402024-12-21T07:52:45.607ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:48530
74412024-12-21T07:52:45.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48530 req_id = 21787d49-f155-42e3-9237-47681a56315f roles = RoleSet { roles: {} } uri = /metrics/producers
74422024-12-21T07:52:45.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48530 req_id = 21787d49-f155-42e3-9237-47681a56315f resource = Database result = Ok(()) uri = /metrics/producers
74432024-12-21T07:52:45.617ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = cae81b8e-6ade-45fa-953a-26f79465611b
74442024-12-21T07:52:45.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10321 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48530 req_id = 21787d49-f155-42e3-9237-47681a56315f response_code = 201 uri = /metrics/producers
74452024-12-21T07:52:45.897ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1277 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = d8e3da04-85fb-469b-941e-b573f7929037 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
74462024-12-21T07:52:50.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 5814533e-445a-4b92-8a5d-bbd5f503b002 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
74472024-12-21T07:52:50.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 5814533e-445a-4b92-8a5d-bbd5f503b002 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
74482024-12-21T07:52:50.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3334 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 5814533e-445a-4b92-8a5d-bbd5f503b002 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
74492024-12-21T07:52:50.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 46b8b7e9-7df1-48b9-a3ed-6ad97f10d41c roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
74502024-12-21T07:52:50.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 46b8b7e9-7df1-48b9-a3ed-6ad97f10d41c resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
74512024-12-21T07:52:50.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2772 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 46b8b7e9-7df1-48b9-a3ed-6ad97f10d41c response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
74522024-12-21T07:52:53.507ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
74532024-12-21T07:52:53.507ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
74542024-12-21T07:52:53.507ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
74552024-12-21T07:52:53.507ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74562024-12-21T07:52:53.507ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
74572024-12-21T07:52:53.507ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
74582024-12-21T07:52:53.507ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
74592024-12-21T07:52:53.507ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
74602024-12-21T07:52:53.507ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
74612024-12-21T07:52:53.507ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
74622024-12-21T07:52:53.507ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
74632024-12-21T07:52:53.507ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74642024-12-21T07:52:53.507ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
74652024-12-21T07:52:53.507ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
74662024-12-21T07:52:53.507ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
74672024-12-21T07:52:53.507ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
74682024-12-21T07:52:53.507ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
74692024-12-21T07:52:53.507ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
74702024-12-21T07:52:53.507ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
74712024-12-21T07:52:53.507ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
74722024-12-21T07:52:53.507ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
74732024-12-21T07:52:53.507ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74742024-12-21T07:52:53.507ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74752024-12-21T07:52:53.507ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
74762024-12-21T07:52:53.507ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
74772024-12-21T07:52:53.507ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
74782024-12-21T07:52:53.507ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
74792024-12-21T07:52:53.507ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
74802024-12-21T07:52:53.507ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
74812024-12-21T07:52:53.507ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
74822024-12-21T07:52:53.507ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74832024-12-21T07:52:53.507ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
74842024-12-21T07:52:53.507ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74852024-12-21T07:52:53.507ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
74862024-12-21T07:52:53.508ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74872024-12-21T07:52:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74882024-12-21T07:52:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74892024-12-21T07:52:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
74902024-12-21T07:52:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
74912024-12-21T07:52:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
74922024-12-21T07:52:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
74932024-12-21T07:52:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
74942024-12-21T07:52:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
74952024-12-21T07:52:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74962024-12-21T07:52:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74972024-12-21T07:52:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
74982024-12-21T07:52:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74992024-12-21T07:52:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75002024-12-21T07:52:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75012024-12-21T07:52:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75022024-12-21T07:52:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
75032024-12-21T07:52:53.509ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75042024-12-21T07:52:53.510ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75052024-12-21T07:52:53.511ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
75062024-12-21T07:52:53.511ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75072024-12-21T07:52:53.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75082024-12-21T07:52:53.512ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.744022ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
75092024-12-21T07:52:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
75102024-12-21T07:52:53.512ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75112024-12-21T07:52:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75122024-12-21T07:52:53.513ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1293, tv_nsec: 463632235 } })
75132024-12-21T07:52:53.513ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
75142024-12-21T07:52:53.516ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1293, tv_nsec: 466206550 } })
75152024-12-21T07:52:53.516ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75162024-12-21T07:52:53.516ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
75172024-12-21T07:52:53.517ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75182024-12-21T07:52:53.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75192024-12-21T07:52:53.519ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75202024-12-21T07:52:53.519ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75212024-12-21T07:52:53.519ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75222024-12-21T07:52:53.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75232024-12-21T07:52:53.522ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
75242024-12-21T07:52:53.522ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
75252024-12-21T07:52:53.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
75262024-12-21T07:52:53.524ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75272024-12-21T07:52:53.525ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75282024-12-21T07:52:53.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75292024-12-21T07:52:53.526ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75302024-12-21T07:52:53.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75312024-12-21T07:52:53.527ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
75322024-12-21T07:52:53.527ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75332024-12-21T07:52:53.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75342024-12-21T07:52:53.559ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
75352024-12-21T07:52:53.559ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
75362024-12-21T07:52:53.559ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75372024-12-21T07:52:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75382024-12-21T07:52:53.566ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75392024-12-21T07:52:53.566ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
75402024-12-21T07:52:53.566ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 58.631116ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
75412024-12-21T07:52:53.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
75422024-12-21T07:52:53.568ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 60.797692ms iteration = 12 status = {"errors":[],"finish_invoked_ok":[]}
75432024-12-21T07:52:53.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
75442024-12-21T07:52:53.568ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75452024-12-21T07:52:53.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75462024-12-21T07:52:53.570ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
75472024-12-21T07:52:53.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
75482024-12-21T07:52:53.570ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75492024-12-21T07:52:53.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75502024-12-21T07:52:53.572ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
75512024-12-21T07:52:53.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75522024-12-21T07:52:53.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
75532024-12-21T07:52:53.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75542024-12-21T07:52:53.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75552024-12-21T07:52:53.577ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 69.196047ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
75562024-12-21T07:52:53.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
75572024-12-21T07:52:53.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75582024-12-21T07:52:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75592024-12-21T07:52:53.581ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 73.43215ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
75602024-12-21T07:52:53.581ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75612024-12-21T07:52:53.583ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75622024-12-21T07:52:53.583ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
75632024-12-21T07:52:53.583ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
75642024-12-21T07:52:53.583ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "eaef085c-8b50-45d4-9426-c71012df54c7", "content-length": "26", "date": "Sat, 21 Dec 2024 07:52:53 GMT"} })
75652024-12-21T07:52:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
75662024-12-21T07:52:53.583ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75672024-12-21T07:52:53.583ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
75682024-12-21T07:52:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75692024-12-21T07:52:53.585ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
75702024-12-21T07:52:53.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
75712024-12-21T07:52:53.585ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75722024-12-21T07:52:53.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75732024-12-21T07:52:53.591ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75742024-12-21T07:52:53.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75752024-12-21T07:52:53.591ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1293, tv_nsec: 542003130 } })
75762024-12-21T07:52:53.592ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
75772024-12-21T07:52:53.604ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
75782024-12-21T07:52:53.604ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 96.545796ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
75792024-12-21T07:52:53.606ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
75802024-12-21T07:52:53.606ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 98.499189ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
75812024-12-21T07:52:53.611ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
75822024-12-21T07:52:53.611ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
75832024-12-21T07:52:53.611ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "db1c75f9-11cb-43d1-99f3-b38abc64567c", "content-length": "26", "date": "Sat, 21 Dec 2024 07:52:53 GMT"} })
75842024-12-21T07:52:53.611ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
75852024-12-21T07:52:53.611ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75862024-12-21T07:52:53.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75872024-12-21T07:52:53.613ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
75882024-12-21T07:52:53.615ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75892024-12-21T07:52:53.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75902024-12-21T07:52:53.617ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
75912024-12-21T07:52:53.617ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
75922024-12-21T07:52:53.617ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75932024-12-21T07:52:53.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75942024-12-21T07:52:53.634ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 126.372378ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
75952024-12-21T07:52:53.635ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 127.63912ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
75962024-12-21T07:52:53.664ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 156.789319ms iteration = 14 status = {"physical_disks_added":0}
75972024-12-21T07:52:53.667ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75982024-12-21T07:52:53.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
75992024-12-21T07:52:53.670ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76002024-12-21T07:52:53.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76012024-12-21T07:52:53.672ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
76022024-12-21T07:52:53.673ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "cbd76249-a599-4e3a-8b73-8cbfbe576354", "content-length": "1", "date": "Sat, 21 Dec 2024 07:52:53 GMT"} })
76032024-12-21T07:52:53.673ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 166.035018ms iteration = 12 status = 0
76042024-12-21T07:52:53.674ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76052024-12-21T07:52:53.674ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
76062024-12-21T07:52:53.674ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 166.384454ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
76072024-12-21T07:52:53.675ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
76082024-12-21T07:52:53.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
76092024-12-21T07:52:53.678ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 170.486745ms iteration = 12 status = null
76102024-12-21T07:52:53.702ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 194.514516ms iteration = 12 status = {}
76112024-12-21T07:52:53.710ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
76122024-12-21T07:52:53.710ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
76132024-12-21T07:52:53.711ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ca18d9e-7cb7-4f99-be5c-ec6cb50caf70", "content-length": "26", "date": "Sat, 21 Dec 2024 07:52:53 GMT"} })
76142024-12-21T07:52:53.711ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
76152024-12-21T07:52:53.713ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
76162024-12-21T07:52:53.730ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
76172024-12-21T07:52:53.730ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
76182024-12-21T07:52:53.730ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a4529bc-05b0-49d8-a154-0f9b1349bdd5", "content-length": "372", "date": "Sat, 21 Dec 2024 07:52:53 GMT"} })
76192024-12-21T07:52:53.730ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76202024-12-21T07:52:53.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76212024-12-21T07:52:53.750ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76222024-12-21T07:52:53.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76232024-12-21T07:52:53.752ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76242024-12-21T07:52:53.754ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
76252024-12-21T07:52:53.754ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76262024-12-21T07:52:53.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76272024-12-21T07:52:53.771ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
76282024-12-21T07:52:53.771ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
76292024-12-21T07:52:53.771ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "eb0fa500-b36f-4e96-8604-f2256b217331", "date": "Sat, 21 Dec 2024 07:52:53 GMT"} })
76302024-12-21T07:52:53.771ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76312024-12-21T07:52:53.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76322024-12-21T07:52:53.773ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76332024-12-21T07:52:53.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76342024-12-21T07:52:53.776ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76352024-12-21T07:52:53.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76362024-12-21T07:52:53.780ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
76372024-12-21T07:52:53.780ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
76382024-12-21T07:52:53.780ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "50579696-230e-402c-a9eb-38c85bae6fda", "date": "Sat, 21 Dec 2024 07:52:53 GMT"} })
76392024-12-21T07:52:53.781ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76402024-12-21T07:52:53.781ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 274.368236ms iteration = 13 status = {}
76412024-12-21T07:52:53.783ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
76422024-12-21T07:52:53.783ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76432024-12-21T07:52:53.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76442024-12-21T07:52:53.852ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76452024-12-21T07:52:53.853ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
76462024-12-21T07:52:53.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76472024-12-21T07:52:53.853ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "9cb7a587-5866-4ad3-97f1-4301ca88ded3", "content-length": "691", "date": "Sat, 21 Dec 2024 07:52:53 GMT"} })
76482024-12-21T07:52:53.853ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
76492024-12-21T07:52:53.853ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
76502024-12-21T07:52:53.853ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
76512024-12-21T07:52:53.855ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
76522024-12-21T07:52:53.855ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76532024-12-21T07:52:53.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76542024-12-21T07:52:53.855ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 347.728124ms iteration = 12 status = {}
76552024-12-21T07:52:53.865ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
76562024-12-21T07:52:53.865ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2bcff2e5-cc98-4105-ad57-92b633505678", "content-length": "134", "date": "Sat, 21 Dec 2024 07:52:53 GMT"} })
76572024-12-21T07:52:53.865ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
76582024-12-21T07:52:53.865ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
76592024-12-21T07:52:53.865ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
76602024-12-21T07:52:53.865ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
76612024-12-21T07:52:53.865ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76622024-12-21T07:52:53.865ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76632024-12-21T07:52:53.865ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76642024-12-21T07:52:53.865ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
76652024-12-21T07:52:53.866ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76662024-12-21T07:52:53.866ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
76672024-12-21T07:52:53.866ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
76682024-12-21T07:52:53.866ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76692024-12-21T07:52:53.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76702024-12-21T07:52:53.868ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
76712024-12-21T07:52:53.868ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "73fa9591-356c-42b3-aca0-bd643987ae66", "content-length": "2", "date": "Sat, 21 Dec 2024 07:52:53 GMT"} })
76722024-12-21T07:52:53.868ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
76732024-12-21T07:52:53.868ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b97d196-79d9-409c-8b01-91e0e3478080", "content-length": "52", "date": "Sat, 21 Dec 2024 07:52:53 GMT"} })
76742024-12-21T07:52:53.868ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
76752024-12-21T07:52:53.868ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
76762024-12-21T07:52:53.967ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a8df76c6-ff25-400f-973b-5381377a9095", "date": "Sat, 21 Dec 2024 07:52:53 GMT"} })
76772024-12-21T07:52:53.967ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
76782024-12-21T07:52:53.967ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
76792024-12-21T07:52:53.968ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef45e7b2-2aef-4464-b8a0-ea51f62ab8a7", "content-length": "682", "date": "Sat, 21 Dec 2024 07:52:53 GMT"} })
76802024-12-21T07:52:53.968ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76812024-12-21T07:52:53.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76822024-12-21T07:52:53.971ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76832024-12-21T07:52:53.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76842024-12-21T07:52:53.975ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76852024-12-21T07:52:53.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76862024-12-21T07:52:53.978ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76872024-12-21T07:52:53.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76882024-12-21T07:52:53.985ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 477.422409ms iteration = 12 status = {}
76892024-12-21T07:52:54.417ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:40430
76902024-12-21T07:52:54.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40430 req_id = 74a1bd0f-74ed-4b8f-8b4f-ebf17309bc42 roles = RoleSet { roles: {} } uri = /metrics/producers
76912024-12-21T07:52:54.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40430 req_id = 74a1bd0f-74ed-4b8f-8b4f-ebf17309bc42 resource = Database result = Ok(()) uri = /metrics/producers
76922024-12-21T07:52:54.455ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
76932024-12-21T07:52:54.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37964 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40430 req_id = 74a1bd0f-74ed-4b8f-8b4f-ebf17309bc42 response_code = 201 uri = /metrics/producers
76942024-12-21T07:52:54.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = e31450be-012c-42e8-8b8e-647779468042 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
76952024-12-21T07:52:54.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = e31450be-012c-42e8-8b8e-647779468042 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
76962024-12-21T07:52:54.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3080 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = e31450be-012c-42e8-8b8e-647779468042 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
76972024-12-21T07:52:55.897ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1127 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 5d4b55fb-080c-4d8e-9710-9fd3165d20a9 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
76982024-12-21T07:52:56.158ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:57186
76992024-12-21T07:52:56.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57186 req_id = fc2f845e-cf79-4ca7-897f-057f5b1f136d roles = RoleSet { roles: {} } uri = /metrics/producers
77002024-12-21T07:52:56.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57186 req_id = fc2f845e-cf79-4ca7-897f-057f5b1f136d resource = Database result = Ok(()) uri = /metrics/producers
77012024-12-21T07:52:56.168ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = 9ad898a3-6e9f-4617-bdb6-642b625a79d4
77022024-12-21T07:52:56.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9653 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57186 req_id = fc2f845e-cf79-4ca7-897f-057f5b1f136d response_code = 201 uri = /metrics/producers
77032024-12-21T07:53:03.507ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
77042024-12-21T07:53:03.507ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
77052024-12-21T07:53:03.507ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77062024-12-21T07:53:03.507ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77072024-12-21T07:53:03.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77082024-12-21T07:53:03.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77092024-12-21T07:53:03.510ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77102024-12-21T07:53:03.512ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77112024-12-21T07:53:03.512ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77122024-12-21T07:53:03.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77132024-12-21T07:53:03.513ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77142024-12-21T07:53:03.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77152024-12-21T07:53:03.515ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77162024-12-21T07:53:03.518ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
77172024-12-21T07:53:03.518ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77182024-12-21T07:53:03.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77192024-12-21T07:53:03.527ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
77202024-12-21T07:53:03.528ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.612904ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
77212024-12-21T07:53:03.536ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77222024-12-21T07:53:03.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77232024-12-21T07:53:03.563ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.211684ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77242024-12-21T07:53:03.763ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:54868
77252024-12-21T07:53:03.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54868 req_id = 619f0802-b8a3-4a90-a345-18ccdd52b818 roles = RoleSet { roles: {} } uri = /metrics/producers
77262024-12-21T07:53:03.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54868 req_id = 619f0802-b8a3-4a90-a345-18ccdd52b818 resource = Database result = Ok(()) uri = /metrics/producers
77272024-12-21T07:53:03.799ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = 34be787b-2c60-4915-afd0-2c1a7062ad84
77282024-12-21T07:53:03.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35495 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54868 req_id = 619f0802-b8a3-4a90-a345-18ccdd52b818 response_code = 201 uri = /metrics/producers
77292024-12-21T07:53:05.898ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1133 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 33a7c322-a35c-4671-bf44-4e6b2715ab9c response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
77302024-12-21T07:53:13.508ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
77312024-12-21T07:53:13.508ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
77322024-12-21T07:53:13.508ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77332024-12-21T07:53:13.508ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77342024-12-21T07:53:13.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77352024-12-21T07:53:13.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77362024-12-21T07:53:13.510ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77372024-12-21T07:53:13.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77382024-12-21T07:53:13.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77392024-12-21T07:53:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77402024-12-21T07:53:13.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77412024-12-21T07:53:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77422024-12-21T07:53:13.543ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.632401ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77432024-12-21T07:53:13.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77442024-12-21T07:53:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77452024-12-21T07:53:13.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77462024-12-21T07:53:13.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
77472024-12-21T07:53:13.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77482024-12-21T07:53:13.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77492024-12-21T07:53:13.558ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
77502024-12-21T07:53:13.558ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.083559ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
77512024-12-21T07:53:15.898ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1194 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 98da4cf9-46f8-42b1-807c-b18f4569a6f0 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
77522024-12-21T07:53:20.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 9629281b-825e-44fb-94e9-e5131562549d roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
77532024-12-21T07:53:20.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 9629281b-825e-44fb-94e9-e5131562549d resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
77542024-12-21T07:53:20.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3367 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 9629281b-825e-44fb-94e9-e5131562549d response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
77552024-12-21T07:53:20.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 44c1e32d-2db9-4bf7-a87c-f45f8c45d4b8 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
77562024-12-21T07:53:20.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 44c1e32d-2db9-4bf7-a87c-f45f8c45d4b8 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
77572024-12-21T07:53:20.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2406 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 44c1e32d-2db9-4bf7-a87c-f45f8c45d4b8 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
77582024-12-21T07:53:23.507ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
77592024-12-21T07:53:23.507ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
77602024-12-21T07:53:23.507ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77612024-12-21T07:53:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77622024-12-21T07:53:23.507ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
77632024-12-21T07:53:23.507ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
77642024-12-21T07:53:23.507ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77652024-12-21T07:53:23.507ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
77662024-12-21T07:53:23.507ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
77672024-12-21T07:53:23.507ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
77682024-12-21T07:53:23.507ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:43:23.507775890 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
77692024-12-21T07:53:23.507ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
77702024-12-21T07:53:23.507ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
77712024-12-21T07:53:23.507ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
77722024-12-21T07:53:23.507ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
77732024-12-21T07:53:23.507ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
77742024-12-21T07:53:23.507ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77752024-12-21T07:53:23.507ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
77762024-12-21T07:53:23.507ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77772024-12-21T07:53:23.507ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77782024-12-21T07:53:23.507ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
77792024-12-21T07:53:23.507ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77802024-12-21T07:53:23.507ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
77812024-12-21T07:53:23.507ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
77822024-12-21T07:53:23.507ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
77832024-12-21T07:53:23.507ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
77842024-12-21T07:53:23.507ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77852024-12-21T07:53:23.507ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
77862024-12-21T07:53:23.507ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
77872024-12-21T07:53:23.507ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
77882024-12-21T07:53:23.507ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
77892024-12-21T07:53:23.507ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77902024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77912024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
77922024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
77932024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
77942024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77952024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
77962024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
77972024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
77982024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
77992024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
78002024-12-21T07:53:23.508ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 3f45718f-9869-448a-a087-788e66db5e9d
78012024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
78022024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
78032024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.41\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"3f45718f-9869-448a-a087-788e66db5e9d"}
78042024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
78052024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
78062024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
78072024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
78082024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
78092024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
78102024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
78112024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
78122024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
78132024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
78142024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78152024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
78162024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78172024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
78182024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
78192024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
78202024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
78212024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
78222024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
78232024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78242024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78252024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
78262024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78272024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
78282024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
78292024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78302024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
78312024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
78322024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78332024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78342024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
78352024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
78362024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
78372024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78382024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
78392024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
78402024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
78412024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78422024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78432024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
78442024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
78452024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
78462024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
78472024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
78482024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
78492024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
78502024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
78512024-12-21T07:53:23.508ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("481de7e8-0737-474b-8c33-e6e8bc6477be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("683a9892-43cd-4dd8-a983-26cccd988df0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1323, tv_nsec: 458528888 } })
78522024-12-21T07:53:23.508ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1595c632-cfae-4f6b-937d-d413dd8cf0b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1323, tv_nsec: 458546368 } })
78532024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
78542024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
78552024-12-21T07:53:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
78562024-12-21T07:53:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
78572024-12-21T07:53:23.509ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
78582024-12-21T07:53:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
78592024-12-21T07:53:23.509ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
78602024-12-21T07:53:23.509ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.152079ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
78612024-12-21T07:53:23.509ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
78622024-12-21T07:53:23.509ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.537476ms iteration = 8 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
78632024-12-21T07:53:23.510ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78642024-12-21T07:53:23.512ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
78652024-12-21T07:53:23.512ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78662024-12-21T07:53:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78672024-12-21T07:53:23.512ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78682024-12-21T07:53:23.512ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78692024-12-21T07:53:23.514ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.061604ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
78702024-12-21T07:53:23.515ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
78712024-12-21T07:53:23.515ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
78722024-12-21T07:53:23.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
78732024-12-21T07:53:23.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
78742024-12-21T07:53:23.516ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78752024-12-21T07:53:23.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78762024-12-21T07:53:23.519ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78772024-12-21T07:53:23.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78782024-12-21T07:53:23.521ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78792024-12-21T07:53:23.521ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:43:23.507775890 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
78802024-12-21T07:53:23.521ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.629294ms iteration = 7 status = {"expiration":"2024-12-21T07:43:23.507775890Z","pruned":[]}
78812024-12-21T07:53:23.525ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
78822024-12-21T07:53:23.525ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
78832024-12-21T07:53:23.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
78842024-12-21T07:53:23.525ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78852024-12-21T07:53:23.528ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
78862024-12-21T07:53:23.528ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
78872024-12-21T07:53:23.528ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 20.276288ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
78882024-12-21T07:53:23.529ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.093612ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
78892024-12-21T07:53:23.530ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
78902024-12-21T07:53:23.530ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78912024-12-21T07:53:23.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78922024-12-21T07:53:23.549ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78932024-12-21T07:53:23.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78942024-12-21T07:53:23.553ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1323, tv_nsec: 503639692 } })
78952024-12-21T07:53:23.554ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
78962024-12-21T07:53:23.554ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78972024-12-21T07:53:23.555ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1323, tv_nsec: 505423352 } })
78982024-12-21T07:53:23.556ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
78992024-12-21T07:53:23.556ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 48.432761ms iteration = 13 status = {"errors":[],"finish_invoked_ok":[]}
79002024-12-21T07:53:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
79012024-12-21T07:53:23.558ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
79022024-12-21T07:53:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
79032024-12-21T07:53:23.561ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79042024-12-21T07:53:23.562ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79052024-12-21T07:53:23.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
79062024-12-21T07:53:23.565ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
79072024-12-21T07:53:23.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
79082024-12-21T07:53:23.565ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
79092024-12-21T07:53:23.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
79102024-12-21T07:53:23.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
79112024-12-21T07:53:23.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79122024-12-21T07:53:23.582ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79132024-12-21T07:53:23.582ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1323, tv_nsec: 532338234 } })
79142024-12-21T07:53:23.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79152024-12-21T07:53:23.583ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
79162024-12-21T07:53:23.583ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
79172024-12-21T07:53:23.583ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
79182024-12-21T07:53:23.583ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
79192024-12-21T07:53:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
79202024-12-21T07:53:23.584ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79212024-12-21T07:53:23.585ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79222024-12-21T07:53:23.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79232024-12-21T07:53:23.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79242024-12-21T07:53:23.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79252024-12-21T07:53:23.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
79262024-12-21T07:53:23.589ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79272024-12-21T07:53:23.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79282024-12-21T07:53:23.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
79292024-12-21T07:53:23.593ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
79302024-12-21T07:53:23.593ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
79312024-12-21T07:53:23.593ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
79322024-12-21T07:53:23.593ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79332024-12-21T07:53:23.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79342024-12-21T07:53:23.594ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79352024-12-21T07:53:23.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79362024-12-21T07:53:23.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79372024-12-21T07:53:23.597ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
79382024-12-21T07:53:23.597ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79392024-12-21T07:53:23.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79402024-12-21T07:53:23.598ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79412024-12-21T07:53:23.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79422024-12-21T07:53:23.618ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79432024-12-21T07:53:23.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
79442024-12-21T07:53:23.623ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79452024-12-21T07:53:23.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79462024-12-21T07:53:23.626ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79472024-12-21T07:53:23.631ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
79482024-12-21T07:53:23.631ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 123.646651ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
79492024-12-21T07:53:23.636ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79502024-12-21T07:53:23.637ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
79512024-12-21T07:53:23.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
79522024-12-21T07:53:23.638ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79532024-12-21T07:53:23.640ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
79542024-12-21T07:53:23.640ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79552024-12-21T07:53:23.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79562024-12-21T07:53:23.641ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
79572024-12-21T07:53:23.641ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
79582024-12-21T07:53:23.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
79592024-12-21T07:53:23.641ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
79602024-12-21T07:53:23.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79612024-12-21T07:53:23.642ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
79622024-12-21T07:53:23.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
79632024-12-21T07:53:23.645ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79642024-12-21T07:53:23.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79652024-12-21T07:53:23.648ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79662024-12-21T07:53:23.652ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79672024-12-21T07:53:23.652ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
79682024-12-21T07:53:23.652ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79692024-12-21T07:53:23.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79702024-12-21T07:53:23.655ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
79712024-12-21T07:53:23.655ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
79722024-12-21T07:53:23.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
79732024-12-21T07:53:23.658ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 150.673775ms iteration = 4 status = {"nsuccess":5}
79742024-12-21T07:53:23.658ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
79752024-12-21T07:53:23.658ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 151.027841ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
79762024-12-21T07:53:23.659ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79772024-12-21T07:53:23.663ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
79782024-12-21T07:53:23.663ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79792024-12-21T07:53:23.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79802024-12-21T07:53:23.677ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
79812024-12-21T07:53:23.677ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 169.923535ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
79822024-12-21T07:53:23.678ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 170.335552ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79832024-12-21T07:53:23.700ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79842024-12-21T07:53:23.701ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
79852024-12-21T07:53:23.701ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
79862024-12-21T07:53:23.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79872024-12-21T07:53:23.701ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 193.360627ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
79882024-12-21T07:53:23.703ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
79892024-12-21T07:53:23.703ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
79902024-12-21T07:53:23.703ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
79912024-12-21T07:53:23.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
79922024-12-21T07:53:23.703ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
79932024-12-21T07:53:23.703ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
79942024-12-21T07:53:23.703ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
79952024-12-21T07:53:23.703ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
79962024-12-21T07:53:23.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
79972024-12-21T07:53:23.704ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79982024-12-21T07:53:23.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79992024-12-21T07:53:23.706ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
80002024-12-21T07:53:23.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
80012024-12-21T07:53:23.708ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80022024-12-21T07:53:23.714ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
80032024-12-21T07:53:23.714ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80042024-12-21T07:53:23.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80052024-12-21T07:53:23.715ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80062024-12-21T07:53:23.715ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80072024-12-21T07:53:23.717ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 209.618245ms iteration = 13 status = 0
80082024-12-21T07:53:23.719ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 211.315145ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
80092024-12-21T07:53:23.720ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
80102024-12-21T07:53:23.720ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
80112024-12-21T07:53:23.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
80122024-12-21T07:53:23.721ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
80132024-12-21T07:53:23.721ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80142024-12-21T07:53:23.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80152024-12-21T07:53:23.727ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 219.636247ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
80162024-12-21T07:53:23.728ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
80172024-12-21T07:53:23.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
80182024-12-21T07:53:23.743ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
80192024-12-21T07:53:23.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
80202024-12-21T07:53:23.746ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
80212024-12-21T07:53:23.748ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80222024-12-21T07:53:23.749ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
80232024-12-21T07:53:23.752ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
80242024-12-21T07:53:23.752ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
80252024-12-21T07:53:23.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
80262024-12-21T07:53:23.760ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
80272024-12-21T07:53:23.760ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
80282024-12-21T07:53:23.760ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 252.622663ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
80292024-12-21T07:53:23.790ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
80302024-12-21T07:53:23.790ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 0 version = 2
80312024-12-21T07:53:23.790ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
80322024-12-21T07:53:23.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
80332024-12-21T07:53:23.792ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80342024-12-21T07:53:23.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80352024-12-21T07:53:23.793ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 285.386895ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
80362024-12-21T07:53:23.793ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80372024-12-21T07:53:23.794ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
80382024-12-21T07:53:23.794ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
80392024-12-21T07:53:23.794ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80402024-12-21T07:53:23.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80412024-12-21T07:53:23.797ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80422024-12-21T07:53:23.799ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
80432024-12-21T07:53:23.799ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
80442024-12-21T07:53:23.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
80452024-12-21T07:53:23.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
80462024-12-21T07:53:23.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80472024-12-21T07:53:23.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80482024-12-21T07:53:23.802ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 1 version = 2
80492024-12-21T07:53:23.802ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
80502024-12-21T07:53:23.802ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 07:47:25.290148 UTC dns_group = external generation = 2
80512024-12-21T07:53:23.802ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 294.363439ms iteration = 8 status = {"generation":2}
80522024-12-21T07:53:23.804ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
80532024-12-21T07:53:23.804ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80542024-12-21T07:53:23.805ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
80552024-12-21T07:53:23.805ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80562024-12-21T07:53:23.805ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3b9db0b-0a52-4e79-a086-e3681dce5b03", "content-length": "26", "date": "Sat, 21 Dec 2024 07:53:23 GMT"} })
80572024-12-21T07:53:23.805ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80582024-12-21T07:53:23.805ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "43ca4baf-2148-4f92-9530-0d39271a65ec", "content-length": "26", "date": "Sat, 21 Dec 2024 07:53:23 GMT"} })
80592024-12-21T07:53:23.805ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80602024-12-21T07:53:23.809ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
80612024-12-21T07:53:23.810ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
80622024-12-21T07:53:23.810ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 07:47:23.936594 UTC dns_group = internal generation = 1
80632024-12-21T07:53:23.810ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 302.755612ms iteration = 8 status = {"generation":1}
80642024-12-21T07:53:23.813ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
80652024-12-21T07:53:23.813ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
80662024-12-21T07:53:23.830ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:47:21.583817Z, time_modified: 2024-12-21T07:47:21.583817Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }) }
80672024-12-21T07:53:23.830ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 322.114264ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]}},"default_endpoint":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
80682024-12-21T07:53:23.832ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
80692024-12-21T07:53:23.832ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80702024-12-21T07:53:23.833ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "95460ff6-7cc3-4d8e-9ebc-2f235d9056bb", "content-length": "26", "date": "Sat, 21 Dec 2024 07:53:23 GMT"} })
80712024-12-21T07:53:23.833ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80722024-12-21T07:53:23.836ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
80732024-12-21T07:53:23.853ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 345.712119ms iteration = 15 status = {"physical_disks_added":0}
80742024-12-21T07:53:23.861ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
80752024-12-21T07:53:23.861ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 353.838379ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
80762024-12-21T07:53:23.921ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80772024-12-21T07:53:23.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80782024-12-21T07:53:23.923ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80792024-12-21T07:53:23.926ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
80802024-12-21T07:53:23.926ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80812024-12-21T07:53:23.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80822024-12-21T07:53:23.928ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80832024-12-21T07:53:23.931ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
80842024-12-21T07:53:23.931ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80852024-12-21T07:53:23.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80862024-12-21T07:53:23.950ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
80872024-12-21T07:53:23.987ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
80882024-12-21T07:53:23.988ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "d85e26ed-f6ee-40ae-8dc8-00764b56766d", "date": "Sat, 21 Dec 2024 07:53:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
80892024-12-21T07:53:23.988ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
80902024-12-21T07:53:23.989ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "4b065be8-4dd8-49ff-9a3d-c5fca6db7b99", "date": "Sat, 21 Dec 2024 07:53:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
80912024-12-21T07:53:23.989ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
80922024-12-21T07:53:23.990ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
80932024-12-21T07:53:23.990ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 482.670548ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
80942024-12-21T07:53:24.110ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
80952024-12-21T07:53:24.110ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
80962024-12-21T07:53:24.110ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "52b9dbdf-c658-41a1-a30a-dc5237f8a542", "content-length": "372", "date": "Sat, 21 Dec 2024 07:53:23 GMT"} })
80972024-12-21T07:53:24.110ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80982024-12-21T07:53:24.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80992024-12-21T07:53:24.111ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 603.406679ms iteration = 13 status = {}
81002024-12-21T07:53:24.124ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
81012024-12-21T07:53:24.124ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
81022024-12-21T07:53:24.125ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e306992a-bcd4-4de7-b772-18fcdb30fa22", "date": "Sat, 21 Dec 2024 07:53:23 GMT"} })
81032024-12-21T07:53:24.125ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81042024-12-21T07:53:24.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81052024-12-21T07:53:24.127ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81062024-12-21T07:53:24.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81072024-12-21T07:53:24.127ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
81082024-12-21T07:53:24.128ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "776ca6ad-2c25-4ca3-83bd-0c76c5e7960d", "date": "Sat, 21 Dec 2024 07:53:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
81092024-12-21T07:53:24.128ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
81102024-12-21T07:53:24.129ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "442df993-a8c9-4e96-9aa4-0d11d6c14296", "date": "Sat, 21 Dec 2024 07:53:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
81112024-12-21T07:53:24.129ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
81122024-12-21T07:53:24.130ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81132024-12-21T07:53:24.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81142024-12-21T07:53:24.131ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "68bf465f-3036-4aae-b887-ba5b128bd35f", "date": "Sat, 21 Dec 2024 07:53:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
81152024-12-21T07:53:24.131ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
81162024-12-21T07:53:24.132ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
81172024-12-21T07:53:24.132ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5b21aac-131f-4a55-ac35-0ce7010b269c", "content-length": "1", "date": "Sat, 21 Dec 2024 07:53:24 GMT"} })
81182024-12-21T07:53:24.134ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
81192024-12-21T07:53:24.134ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 626.346083ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
81202024-12-21T07:53:24.135ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
81212024-12-21T07:53:24.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
81222024-12-21T07:53:24.156ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
81232024-12-21T07:53:24.156ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "475ce8e7-bdde-4ad4-8ad0-f956074c603d", "content-length": "691", "date": "Sat, 21 Dec 2024 07:53:23 GMT"} })
81242024-12-21T07:53:24.156ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
81252024-12-21T07:53:24.156ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
81262024-12-21T07:53:24.156ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
81272024-12-21T07:53:24.158ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 650.456987ms iteration = 13 status = null
81282024-12-21T07:53:24.158ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 650.912874ms iteration = 13 status = {}
81292024-12-21T07:53:24.160ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
81302024-12-21T07:53:24.160ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81312024-12-21T07:53:24.160ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "610d43b7-dbb7-40d0-a006-e3c5276fec79", "date": "Sat, 21 Dec 2024 07:53:23 GMT"} })
81322024-12-21T07:53:24.161ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 654.157209ms iteration = 14 status = {}
81332024-12-21T07:53:24.173ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81342024-12-21T07:53:24.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81352024-12-21T07:53:24.175ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
81362024-12-21T07:53:24.175ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81372024-12-21T07:53:24.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81382024-12-21T07:53:24.181ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
81392024-12-21T07:53:24.182ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e5ce3bf-1ede-4d3e-bf1a-f62e4cd0ff7b", "content-length": "134", "date": "Sat, 21 Dec 2024 07:53:24 GMT"} })
81402024-12-21T07:53:24.182ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
81412024-12-21T07:53:24.182ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
81422024-12-21T07:53:24.182ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
81432024-12-21T07:53:24.182ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
81442024-12-21T07:53:24.182ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81452024-12-21T07:53:24.182ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81462024-12-21T07:53:24.182ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81472024-12-21T07:53:24.182ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
81482024-12-21T07:53:24.182ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81492024-12-21T07:53:24.182ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
81502024-12-21T07:53:24.182ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
81512024-12-21T07:53:24.182ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81522024-12-21T07:53:24.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81532024-12-21T07:53:24.184ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
81542024-12-21T07:53:24.184ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "428f7172-61e6-445a-8e12-3c8fe2969953", "content-length": "2", "date": "Sat, 21 Dec 2024 07:53:24 GMT"} })
81552024-12-21T07:53:24.184ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
81562024-12-21T07:53:24.184ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "324d9e36-fdce-4665-85d3-71a32cd3820b", "content-length": "52", "date": "Sat, 21 Dec 2024 07:53:24 GMT"} })
81572024-12-21T07:53:24.184ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
81582024-12-21T07:53:24.184ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
81592024-12-21T07:53:24.363ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "31a7c7bb-35fd-4cb4-9664-3ba7eadae107", "date": "Sat, 21 Dec 2024 07:53:23 GMT"} })
81602024-12-21T07:53:24.363ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
81612024-12-21T07:53:24.363ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
81622024-12-21T07:53:24.367ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f41febe-3fe2-423a-bbb5-c02740f7be2d", "content-length": "682", "date": "Sat, 21 Dec 2024 07:53:24 GMT"} })
81632024-12-21T07:53:24.367ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81642024-12-21T07:53:24.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81652024-12-21T07:53:24.371ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81662024-12-21T07:53:24.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81672024-12-21T07:53:24.374ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81682024-12-21T07:53:24.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81692024-12-21T07:53:24.376ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81702024-12-21T07:53:24.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81712024-12-21T07:53:24.383ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 875.889143ms iteration = 13 status = {}
81722024-12-21T07:53:24.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = a5fa7387-85b7-44f1-9f7f-7993da4138a4 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
81732024-12-21T07:53:24.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = a5fa7387-85b7-44f1-9f7f-7993da4138a4 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
81742024-12-21T07:53:24.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3056 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = a5fa7387-85b7-44f1-9f7f-7993da4138a4 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
81752024-12-21T07:53:25.898ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1216 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 0bd99c7e-448c-4ae8-bab1-bc4e9fcfc345 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
81762024-12-21T07:53:33.508ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
81772024-12-21T07:53:33.508ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
81782024-12-21T07:53:33.508ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81792024-12-21T07:53:33.508ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81802024-12-21T07:53:33.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81812024-12-21T07:53:33.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81822024-12-21T07:53:33.510ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81832024-12-21T07:53:33.510ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81842024-12-21T07:53:33.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81852024-12-21T07:53:33.512ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.522638ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81862024-12-21T07:53:33.512ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81872024-12-21T07:53:33.512ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81882024-12-21T07:53:33.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81892024-12-21T07:53:33.514ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81902024-12-21T07:53:33.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81912024-12-21T07:53:33.515ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81922024-12-21T07:53:33.518ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
81932024-12-21T07:53:33.518ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81942024-12-21T07:53:33.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81952024-12-21T07:53:33.529ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
81962024-12-21T07:53:33.530ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.710102ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
81972024-12-21T07:53:35.899ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1297 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = a370ca6c-1cc0-4bea-9c69-720185b2ed5e response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
81982024-12-21T07:53:43.508ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
81992024-12-21T07:53:43.508ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
82002024-12-21T07:53:43.508ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82012024-12-21T07:53:43.508ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82022024-12-21T07:53:43.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82032024-12-21T07:53:43.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82042024-12-21T07:53:43.511ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82052024-12-21T07:53:43.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82062024-12-21T07:53:43.511ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82072024-12-21T07:53:43.513ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.726001ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82082024-12-21T07:53:43.513ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82092024-12-21T07:53:43.513ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82102024-12-21T07:53:43.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82112024-12-21T07:53:43.515ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82122024-12-21T07:53:43.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82132024-12-21T07:53:43.516ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82142024-12-21T07:53:43.519ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
82152024-12-21T07:53:43.519ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82162024-12-21T07:53:43.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82172024-12-21T07:53:43.527ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
82182024-12-21T07:53:43.527ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.205099ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
82192024-12-21T07:53:45.899ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1306 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 83213b5d-8cdf-4cc4-abe8-28726bb60164 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
82202024-12-21T07:53:53.508ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
82212024-12-21T07:53:53.508ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
82222024-12-21T07:53:53.508ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
82232024-12-21T07:53:53.508ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82242024-12-21T07:53:53.508ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
82252024-12-21T07:53:53.508ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
82262024-12-21T07:53:53.508ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82272024-12-21T07:53:53.508ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82282024-12-21T07:53:53.508ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
82292024-12-21T07:53:53.508ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82302024-12-21T07:53:53.508ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
82312024-12-21T07:53:53.508ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
82322024-12-21T07:53:53.508ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
82332024-12-21T07:53:53.508ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
82342024-12-21T07:53:53.508ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
82352024-12-21T07:53:53.508ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
82362024-12-21T07:53:53.508ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
82372024-12-21T07:53:53.508ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82382024-12-21T07:53:53.508ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
82392024-12-21T07:53:53.508ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
82402024-12-21T07:53:53.508ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
82412024-12-21T07:53:53.508ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
82422024-12-21T07:53:53.508ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
82432024-12-21T07:53:53.508ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
82442024-12-21T07:53:53.508ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
82452024-12-21T07:53:53.508ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82462024-12-21T07:53:53.508ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
82472024-12-21T07:53:53.508ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
82482024-12-21T07:53:53.508ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
82492024-12-21T07:53:53.508ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
82502024-12-21T07:53:53.508ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
82512024-12-21T07:53:53.508ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
82522024-12-21T07:53:53.508ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
82532024-12-21T07:53:53.508ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
82542024-12-21T07:53:53.508ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82552024-12-21T07:53:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82562024-12-21T07:53:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
82572024-12-21T07:53:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82582024-12-21T07:53:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82592024-12-21T07:53:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82602024-12-21T07:53:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
82612024-12-21T07:53:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
82622024-12-21T07:53:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
82632024-12-21T07:53:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
82642024-12-21T07:53:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82652024-12-21T07:53:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
82662024-12-21T07:53:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82672024-12-21T07:53:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82682024-12-21T07:53:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
82692024-12-21T07:53:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
82702024-12-21T07:53:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
82712024-12-21T07:53:53.511ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82722024-12-21T07:53:53.511ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.050063ms iteration = 14 status = {"errors":[],"finish_invoked_ok":[]}
82732024-12-21T07:53:53.511ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82742024-12-21T07:53:53.513ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82752024-12-21T07:53:53.513ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.66731ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
82762024-12-21T07:53:53.513ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
82772024-12-21T07:53:53.513ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82782024-12-21T07:53:53.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82792024-12-21T07:53:53.514ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
82802024-12-21T07:53:53.514ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82812024-12-21T07:53:53.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82822024-12-21T07:53:53.517ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
82832024-12-21T07:53:53.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
82842024-12-21T07:53:53.517ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
82852024-12-21T07:53:53.517ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82862024-12-21T07:53:53.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82872024-12-21T07:53:53.520ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82882024-12-21T07:53:53.520ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82892024-12-21T07:53:53.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82902024-12-21T07:53:53.521ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82912024-12-21T07:53:53.521ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1353, tv_nsec: 471333018 } })
82922024-12-21T07:53:53.522ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
82932024-12-21T07:53:53.523ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
82942024-12-21T07:53:53.523ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
82952024-12-21T07:53:53.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
82962024-12-21T07:53:53.524ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82972024-12-21T07:53:53.524ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82982024-12-21T07:53:53.524ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82992024-12-21T07:53:53.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83002024-12-21T07:53:53.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83012024-12-21T07:53:53.526ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83022024-12-21T07:53:53.526ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1353, tv_nsec: 476164710 } })
83032024-12-21T07:53:53.527ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
83042024-12-21T07:53:53.527ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83052024-12-21T07:53:53.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83062024-12-21T07:53:53.528ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
83072024-12-21T07:53:53.528ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83082024-12-21T07:53:53.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83092024-12-21T07:53:53.530ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
83102024-12-21T07:53:53.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
83112024-12-21T07:53:53.531ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1353, tv_nsec: 480433084 } })
83122024-12-21T07:53:53.531ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
83132024-12-21T07:53:53.531ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83142024-12-21T07:53:53.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83152024-12-21T07:53:53.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83162024-12-21T07:53:53.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83172024-12-21T07:53:53.533ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83182024-12-21T07:53:53.533ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83192024-12-21T07:53:53.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83202024-12-21T07:53:53.536ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
83212024-12-21T07:53:53.536ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83222024-12-21T07:53:53.536ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
83232024-12-21T07:53:53.536ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83242024-12-21T07:53:53.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83252024-12-21T07:53:53.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83262024-12-21T07:53:53.537ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83272024-12-21T07:53:53.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83282024-12-21T07:53:53.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
83292024-12-21T07:53:53.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83302024-12-21T07:53:53.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83312024-12-21T07:53:53.550ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
83322024-12-21T07:53:53.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
83332024-12-21T07:53:53.552ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
83342024-12-21T07:53:53.552ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 43.7044ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
83352024-12-21T07:53:53.554ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
83362024-12-21T07:53:53.554ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
83372024-12-21T07:53:53.554ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83382024-12-21T07:53:53.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83392024-12-21T07:53:53.555ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83402024-12-21T07:53:53.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83412024-12-21T07:53:53.558ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 49.482578ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
83422024-12-21T07:53:53.568ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.667133ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83432024-12-21T07:53:53.568ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
83442024-12-21T07:53:53.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
83452024-12-21T07:53:53.573ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83462024-12-21T07:53:53.575ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
83472024-12-21T07:53:53.575ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83482024-12-21T07:53:53.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83492024-12-21T07:53:53.576ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 68.446064ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
83502024-12-21T07:53:53.581ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
83512024-12-21T07:53:53.581ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 72.914191ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
83522024-12-21T07:53:53.594ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 86.372451ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
83532024-12-21T07:53:53.598ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
83542024-12-21T07:53:53.598ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
83552024-12-21T07:53:53.598ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83562024-12-21T07:53:53.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83572024-12-21T07:53:53.659ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
83582024-12-21T07:53:53.659ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
83592024-12-21T07:53:53.659ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d17ca1bd-0232-442e-ae53-01e3c288b12a", "content-length": "26", "date": "Sat, 21 Dec 2024 07:53:53 GMT"} })
83602024-12-21T07:53:53.659ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
83612024-12-21T07:53:53.661ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
83622024-12-21T07:53:53.664ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
83632024-12-21T07:53:53.664ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
83642024-12-21T07:53:53.664ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "57e452b5-d77b-48df-9df6-197a3e710aae", "content-length": "26", "date": "Sat, 21 Dec 2024 07:53:53 GMT"} })
83652024-12-21T07:53:53.665ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
83662024-12-21T07:53:53.667ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 158.935356ms iteration = 16 status = {"physical_disks_added":0}
83672024-12-21T07:53:53.668ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
83682024-12-21T07:53:53.731ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
83692024-12-21T07:53:53.731ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
83702024-12-21T07:53:53.731ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "46e65920-360a-4533-8f14-e44bc0d8bb3e", "content-length": "26", "date": "Sat, 21 Dec 2024 07:53:53 GMT"} })
83712024-12-21T07:53:53.731ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
83722024-12-21T07:53:53.733ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
83732024-12-21T07:53:53.757ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
83742024-12-21T07:53:53.757ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
83752024-12-21T07:53:53.758ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "76b34330-d476-41bb-8a4a-7718666bd39c", "content-length": "372", "date": "Sat, 21 Dec 2024 07:53:53 GMT"} })
83762024-12-21T07:53:53.758ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83772024-12-21T07:53:53.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83782024-12-21T07:53:53.760ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83792024-12-21T07:53:53.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83802024-12-21T07:53:53.760ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83812024-12-21T07:53:53.763ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
83822024-12-21T07:53:53.763ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83832024-12-21T07:53:53.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83842024-12-21T07:53:53.790ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
83852024-12-21T07:53:53.790ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
83862024-12-21T07:53:53.790ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 281.61993ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
83872024-12-21T07:53:53.792ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83882024-12-21T07:53:53.795ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
83892024-12-21T07:53:53.795ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83902024-12-21T07:53:53.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83912024-12-21T07:53:53.797ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 288.963856ms iteration = 14 status = 0
83922024-12-21T07:53:53.799ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 290.793748ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
83932024-12-21T07:53:53.809ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
83942024-12-21T07:53:53.809ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
83952024-12-21T07:53:53.810ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "51ef909e-1cca-46e7-a571-0c14205d52ea", "date": "Sat, 21 Dec 2024 07:53:53 GMT"} })
83962024-12-21T07:53:53.810ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83972024-12-21T07:53:53.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83982024-12-21T07:53:53.813ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83992024-12-21T07:53:53.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84002024-12-21T07:53:53.819ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84012024-12-21T07:53:53.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84022024-12-21T07:53:53.823ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
84032024-12-21T07:53:53.823ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
84042024-12-21T07:53:53.824ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e82a537e-4e30-4d4e-a823-bb8e19080c4e", "date": "Sat, 21 Dec 2024 07:53:53 GMT"} })
84052024-12-21T07:53:53.825ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 316.832814ms iteration = 15 status = {}
84062024-12-21T07:53:53.859ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 351.073742ms iteration = 14 status = {}
84072024-12-21T07:53:53.861ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
84082024-12-21T07:53:53.861ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ce184e1-74fc-4e92-b785-e0bc468879f7", "content-length": "1", "date": "Sat, 21 Dec 2024 07:53:53 GMT"} })
84092024-12-21T07:53:53.863ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
84102024-12-21T07:53:53.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
84112024-12-21T07:53:53.866ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 357.428911ms iteration = 14 status = null
84122024-12-21T07:53:53.904ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
84132024-12-21T07:53:53.950ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84142024-12-21T07:53:53.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84152024-12-21T07:53:53.953ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
84162024-12-21T07:53:53.953ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84172024-12-21T07:53:53.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84182024-12-21T07:53:53.960ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a9b50033-52b7-4608-bcbd-69e96eb72adb", "content-length": "691", "date": "Sat, 21 Dec 2024 07:53:53 GMT"} })
84192024-12-21T07:53:53.960ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
84202024-12-21T07:53:53.960ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
84212024-12-21T07:53:53.960ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
84222024-12-21T07:53:53.962ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 453.823384ms iteration = 14 status = {}
84232024-12-21T07:53:53.964ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
84242024-12-21T07:53:53.964ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f34a23b8-f7f4-47b5-a776-d940bb6be0c7", "content-length": "134", "date": "Sat, 21 Dec 2024 07:53:53 GMT"} })
84252024-12-21T07:53:53.964ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
84262024-12-21T07:53:53.964ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
84272024-12-21T07:53:53.964ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
84282024-12-21T07:53:53.964ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
84292024-12-21T07:53:53.964ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84302024-12-21T07:53:53.964ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84312024-12-21T07:53:53.964ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84322024-12-21T07:53:53.964ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
84332024-12-21T07:53:53.965ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84342024-12-21T07:53:53.965ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
84352024-12-21T07:53:53.965ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
84362024-12-21T07:53:53.965ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84372024-12-21T07:53:53.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84382024-12-21T07:53:53.966ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
84392024-12-21T07:53:53.966ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f55ac14c-ba1d-4d50-8add-3551abd25040", "content-length": "2", "date": "Sat, 21 Dec 2024 07:53:53 GMT"} })
84402024-12-21T07:53:53.966ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
84412024-12-21T07:53:53.967ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee73534e-3a53-4abf-abc7-40ec2d9b75df", "content-length": "52", "date": "Sat, 21 Dec 2024 07:53:53 GMT"} })
84422024-12-21T07:53:53.967ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
84432024-12-21T07:53:53.967ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
84442024-12-21T07:53:54.066ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e9672b79-b5c5-4b5c-b136-de49019e5edd", "date": "Sat, 21 Dec 2024 07:53:53 GMT"} })
84452024-12-21T07:53:54.066ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
84462024-12-21T07:53:54.066ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
84472024-12-21T07:53:54.071ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "87a65cf0-76e1-4ffd-a173-5f52415c47ef", "content-length": "682", "date": "Sat, 21 Dec 2024 07:53:53 GMT"} })
84482024-12-21T07:53:54.071ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84492024-12-21T07:53:54.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84502024-12-21T07:53:54.075ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84512024-12-21T07:53:54.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84522024-12-21T07:53:54.079ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84532024-12-21T07:53:54.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84542024-12-21T07:53:54.081ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84552024-12-21T07:53:54.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84562024-12-21T07:53:54.088ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 580.274133ms iteration = 14 status = {}
84572024-12-21T07:53:54.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = f2eaed3b-80c6-46a6-9fcd-989153522538 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
84582024-12-21T07:53:54.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = f2eaed3b-80c6-46a6-9fcd-989153522538 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
84592024-12-21T07:53:54.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3277 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = f2eaed3b-80c6-46a6-9fcd-989153522538 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
84602024-12-21T07:53:55.899ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1162 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = f49a4865-2a02-4923-bd49-188004904d00 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
84612024-12-21T07:54:03.508ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
84622024-12-21T07:54:03.508ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
84632024-12-21T07:54:03.508ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84642024-12-21T07:54:03.508ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84652024-12-21T07:54:03.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84662024-12-21T07:54:03.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84672024-12-21T07:54:03.510ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84682024-12-21T07:54:03.513ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84692024-12-21T07:54:03.513ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84702024-12-21T07:54:03.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84712024-12-21T07:54:03.515ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84722024-12-21T07:54:03.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84732024-12-21T07:54:03.517ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84742024-12-21T07:54:03.519ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
84752024-12-21T07:54:03.519ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84762024-12-21T07:54:03.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84772024-12-21T07:54:03.530ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
84782024-12-21T07:54:03.530ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.619358ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
84792024-12-21T07:54:03.538ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84802024-12-21T07:54:03.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84812024-12-21T07:54:03.567ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.944311ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84822024-12-21T07:54:05.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 5a27aea9-4a7f-4d52-9ec9-25483f7f940f roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
84832024-12-21T07:54:05.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 5a27aea9-4a7f-4d52-9ec9-25483f7f940f resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
84842024-12-21T07:54:05.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2909 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 5a27aea9-4a7f-4d52-9ec9-25483f7f940f response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
84852024-12-21T07:54:05.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 004bf17f-86fd-4e21-81b9-de659379caf5 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
84862024-12-21T07:54:05.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 004bf17f-86fd-4e21-81b9-de659379caf5 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
84872024-12-21T07:54:05.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2935 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 004bf17f-86fd-4e21-81b9-de659379caf5 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
84882024-12-21T07:54:05.899ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1249 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = dca2b5e8-9492-4eee-a13e-95a03724ede7 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
84892024-12-21T07:54:13.508ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
84902024-12-21T07:54:13.509ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
84912024-12-21T07:54:13.509ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84922024-12-21T07:54:13.509ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84932024-12-21T07:54:13.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84942024-12-21T07:54:13.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84952024-12-21T07:54:13.511ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84962024-12-21T07:54:13.511ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84972024-12-21T07:54:13.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84982024-12-21T07:54:13.513ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.175472ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84992024-12-21T07:54:13.513ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85002024-12-21T07:54:13.513ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85012024-12-21T07:54:13.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85022024-12-21T07:54:13.515ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85032024-12-21T07:54:13.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85042024-12-21T07:54:13.517ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85052024-12-21T07:54:13.519ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
85062024-12-21T07:54:13.519ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85072024-12-21T07:54:13.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85082024-12-21T07:54:13.528ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
85092024-12-21T07:54:13.528ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.401142ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
85102024-12-21T07:54:15.899ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1176 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = bc438fd5-6d93-43ee-8bcc-ce5ce93ebeae response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
85112024-12-21T07:54:23.507ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
85122024-12-21T07:54:23.507ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
85132024-12-21T07:54:23.507ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85142024-12-21T07:54:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85152024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
85162024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
85172024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
85182024-12-21T07:54:23.509ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
85192024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
85202024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
85212024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
85222024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
85232024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
85242024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
85252024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85262024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
85272024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85282024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85292024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
85302024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
85312024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
85322024-12-21T07:54:23.509ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 3f45718f-9869-448a-a087-788e66db5e9d
85332024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.941\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"3f45718f-9869-448a-a087-788e66db5e9d"}
85342024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
85352024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
85362024-12-21T07:54:23.509ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:44:23.509221803 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
85372024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
85382024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
85392024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85402024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
85412024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
85422024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
85432024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
85442024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
85452024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
85462024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
85472024-12-21T07:54:23.509ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
85482024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85492024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
85502024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
85512024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
85522024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85532024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
85542024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
85552024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85562024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
85572024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
85582024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
85592024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
85602024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
85612024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
85622024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
85632024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
85642024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
85652024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85662024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
85672024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
85682024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
85692024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
85702024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
85712024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
85722024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85732024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
85742024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
85752024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
85762024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85772024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
85782024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85792024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
85802024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85812024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85822024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
85832024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
85842024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
85852024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
85862024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
85872024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
85882024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85892024-12-21T07:54:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
85902024-12-21T07:54:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85912024-12-21T07:54:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
85922024-12-21T07:54:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85932024-12-21T07:54:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85942024-12-21T07:54:23.510ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("481de7e8-0737-474b-8c33-e6e8bc6477be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("683a9892-43cd-4dd8-a983-26cccd988df0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1383, tv_nsec: 459070847 } })
85952024-12-21T07:54:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
85962024-12-21T07:54:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
85972024-12-21T07:54:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85982024-12-21T07:54:23.510ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1595c632-cfae-4f6b-937d-d413dd8cf0b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1383, tv_nsec: 459122708 } })
85992024-12-21T07:54:23.510ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
86002024-12-21T07:54:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
86012024-12-21T07:54:23.510ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
86022024-12-21T07:54:23.510ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.18325ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
86032024-12-21T07:54:23.510ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
86042024-12-21T07:54:23.510ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.414184ms iteration = 9 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
86052024-12-21T07:54:23.516ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 7.179213ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
86062024-12-21T07:54:23.518ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86072024-12-21T07:54:23.518ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86082024-12-21T07:54:23.518ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86092024-12-21T07:54:23.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86102024-12-21T07:54:23.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86112024-12-21T07:54:23.521ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
86122024-12-21T07:54:23.521ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86132024-12-21T07:54:23.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86142024-12-21T07:54:23.523ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86152024-12-21T07:54:23.525ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86162024-12-21T07:54:23.526ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
86172024-12-21T07:54:23.526ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86182024-12-21T07:54:23.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86192024-12-21T07:54:23.526ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86202024-12-21T07:54:23.526ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.570972ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
86212024-12-21T07:54:23.528ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:44:23.509221803 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
86222024-12-21T07:54:23.528ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 18.853333ms iteration = 8 status = {"expiration":"2024-12-21T07:44:23.509221803Z","pruned":[]}
86232024-12-21T07:54:23.528ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1383, tv_nsec: 477308170 } })
86242024-12-21T07:54:23.528ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
86252024-12-21T07:54:23.528ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
86262024-12-21T07:54:23.528ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
86272024-12-21T07:54:23.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
86282024-12-21T07:54:23.529ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
86292024-12-21T07:54:23.529ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86302024-12-21T07:54:23.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86312024-12-21T07:54:23.532ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1383, tv_nsec: 481259838 } })
86322024-12-21T07:54:23.532ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
86332024-12-21T07:54:23.534ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86342024-12-21T07:54:23.536ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
86352024-12-21T07:54:23.536ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
86362024-12-21T07:54:23.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
86372024-12-21T07:54:23.540ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86382024-12-21T07:54:23.540ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86392024-12-21T07:54:23.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86402024-12-21T07:54:23.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86412024-12-21T07:54:23.544ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1383, tv_nsec: 493418056 } })
86422024-12-21T07:54:23.544ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
86432024-12-21T07:54:23.546ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
86442024-12-21T07:54:23.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
86452024-12-21T07:54:23.592ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
86462024-12-21T07:54:23.592ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
86472024-12-21T07:54:23.592ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
86482024-12-21T07:54:23.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
86492024-12-21T07:54:23.596ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 86.581965ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
86502024-12-21T07:54:23.597ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
86512024-12-21T07:54:23.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
86522024-12-21T07:54:23.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
86532024-12-21T07:54:23.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
86542024-12-21T07:54:23.602ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 93.426913ms iteration = 15 status = {"errors":[],"finish_invoked_ok":[]}
86552024-12-21T07:54:23.604ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 95.03469ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86562024-12-21T07:54:23.604ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86572024-12-21T07:54:23.606ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 96.680288ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
86582024-12-21T07:54:23.606ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
86592024-12-21T07:54:23.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
86602024-12-21T07:54:23.608ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
86612024-12-21T07:54:23.608ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
86622024-12-21T07:54:23.608ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 98.936637ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
86632024-12-21T07:54:23.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
86642024-12-21T07:54:23.609ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86652024-12-21T07:54:23.610ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86662024-12-21T07:54:23.611ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 102.503858ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
86672024-12-21T07:54:23.614ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
86682024-12-21T07:54:23.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
86692024-12-21T07:54:23.614ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
86702024-12-21T07:54:23.614ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
86712024-12-21T07:54:23.614ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 105.191054ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
86722024-12-21T07:54:23.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
86732024-12-21T07:54:23.614ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86742024-12-21T07:54:23.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
86752024-12-21T07:54:23.618ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
86762024-12-21T07:54:23.618ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86772024-12-21T07:54:23.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86782024-12-21T07:54:23.630ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86792024-12-21T07:54:23.633ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
86802024-12-21T07:54:23.633ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86812024-12-21T07:54:23.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86822024-12-21T07:54:23.640ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86832024-12-21T07:54:23.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86842024-12-21T07:54:23.644ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
86852024-12-21T07:54:23.644ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86862024-12-21T07:54:23.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86872024-12-21T07:54:23.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86882024-12-21T07:54:23.646ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86892024-12-21T07:54:23.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86902024-12-21T07:54:23.649ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86912024-12-21T07:54:23.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86922024-12-21T07:54:23.650ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
86932024-12-21T07:54:23.650ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
86942024-12-21T07:54:23.650ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
86952024-12-21T07:54:23.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
86962024-12-21T07:54:23.657ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
86972024-12-21T07:54:23.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
86982024-12-21T07:54:23.664ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86992024-12-21T07:54:23.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87002024-12-21T07:54:23.665ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87012024-12-21T07:54:23.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
87022024-12-21T07:54:23.670ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87032024-12-21T07:54:23.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
87042024-12-21T07:54:23.673ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87052024-12-21T07:54:23.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87062024-12-21T07:54:23.678ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
87072024-12-21T07:54:23.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
87082024-12-21T07:54:23.679ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87092024-12-21T07:54:23.683ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
87102024-12-21T07:54:23.683ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87112024-12-21T07:54:23.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87122024-12-21T07:54:23.684ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
87132024-12-21T07:54:23.684ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
87142024-12-21T07:54:23.684ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
87152024-12-21T07:54:23.684ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
87162024-12-21T07:54:23.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
87172024-12-21T07:54:23.687ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 178.247008ms iteration = 15 status = 0
87182024-12-21T07:54:23.687ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
87192024-12-21T07:54:23.687ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
87202024-12-21T07:54:23.688ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8beea3b1-c3ca-4d4c-bdc9-6c76902f681c", "content-length": "26", "date": "Sat, 21 Dec 2024 07:54:23 GMT"} })
87212024-12-21T07:54:23.688ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
87222024-12-21T07:54:23.690ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
87232024-12-21T07:54:23.711ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
87242024-12-21T07:54:23.711ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
87252024-12-21T07:54:23.711ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
87262024-12-21T07:54:23.711ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
87272024-12-21T07:54:23.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
87282024-12-21T07:54:23.713ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
87292024-12-21T07:54:23.713ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
87302024-12-21T07:54:23.713ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 203.777635ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
87312024-12-21T07:54:23.713ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
87322024-12-21T07:54:23.720ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
87332024-12-21T07:54:23.720ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 211.198253ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
87342024-12-21T07:54:23.723ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87352024-12-21T07:54:23.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
87362024-12-21T07:54:23.746ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87372024-12-21T07:54:23.746ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87382024-12-21T07:54:23.750ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
87392024-12-21T07:54:23.750ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87402024-12-21T07:54:23.750ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
87412024-12-21T07:54:23.750ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
87422024-12-21T07:54:23.750ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 241.032094ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
87432024-12-21T07:54:23.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87442024-12-21T07:54:23.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
87452024-12-21T07:54:23.762ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 253.304295ms iteration = 17 status = {"physical_disks_added":0}
87462024-12-21T07:54:23.764ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87472024-12-21T07:54:23.765ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87482024-12-21T07:54:23.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87492024-12-21T07:54:23.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
87502024-12-21T07:54:23.768ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
87512024-12-21T07:54:23.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
87522024-12-21T07:54:23.768ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
87532024-12-21T07:54:23.768ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 259.620713ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
87542024-12-21T07:54:23.771ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
87552024-12-21T07:54:23.771ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 0 version = 2
87562024-12-21T07:54:23.771ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
87572024-12-21T07:54:23.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
87582024-12-21T07:54:23.773ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87592024-12-21T07:54:23.777ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
87602024-12-21T07:54:23.777ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
87612024-12-21T07:54:23.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
87622024-12-21T07:54:23.777ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87632024-12-21T07:54:23.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87642024-12-21T07:54:23.778ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87652024-12-21T07:54:23.779ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 1 version = 2
87662024-12-21T07:54:23.779ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
87672024-12-21T07:54:23.779ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 07:47:25.290148 UTC dns_group = external generation = 2
87682024-12-21T07:54:23.779ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 270.124873ms iteration = 9 status = {"generation":2}
87692024-12-21T07:54:23.780ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
87702024-12-21T07:54:23.780ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87712024-12-21T07:54:23.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87722024-12-21T07:54:23.782ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87732024-12-21T07:54:23.782ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87742024-12-21T07:54:23.784ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
87752024-12-21T07:54:23.784ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
87762024-12-21T07:54:23.784ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87772024-12-21T07:54:23.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
87782024-12-21T07:54:23.784ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
87792024-12-21T07:54:23.784ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87802024-12-21T07:54:23.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87812024-12-21T07:54:23.794ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
87822024-12-21T07:54:23.794ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
87832024-12-21T07:54:23.794ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
87842024-12-21T07:54:23.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
87852024-12-21T07:54:23.826ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
87862024-12-21T07:54:23.826ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 316.813373ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
87872024-12-21T07:54:23.829ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
87882024-12-21T07:54:23.829ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
87892024-12-21T07:54:23.829ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "475d3ad3-4059-4e9b-828d-373e6ef78776", "content-length": "26", "date": "Sat, 21 Dec 2024 07:54:23 GMT"} })
87902024-12-21T07:54:23.829ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
87912024-12-21T07:54:23.832ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
87922024-12-21T07:54:23.838ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:47:21.583817Z, time_modified: 2024-12-21T07:47:21.583817Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }) }
87932024-12-21T07:54:23.838ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 329.41119ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]}},"default_endpoint":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
87942024-12-21T07:54:23.876ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
87952024-12-21T07:54:23.888ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
87962024-12-21T07:54:23.888ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "064bb5d4-7af7-400a-92f0-01b8e5977de1", "content-length": "1", "date": "Sat, 21 Dec 2024 07:54:23 GMT"} })
87972024-12-21T07:54:23.890ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
87982024-12-21T07:54:23.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
87992024-12-21T07:54:23.933ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
88002024-12-21T07:54:23.933ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
88012024-12-21T07:54:23.934ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "86c642a4-756c-4f31-96c1-40c42297886c", "content-length": "26", "date": "Sat, 21 Dec 2024 07:54:23 GMT"} })
88022024-12-21T07:54:23.934ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
88032024-12-21T07:54:23.935ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
88042024-12-21T07:54:23.965ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
88052024-12-21T07:54:24.003ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
88062024-12-21T07:54:24.004ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "fd8a7393-4d8f-4937-a8a1-588fcd6a8e61", "date": "Sat, 21 Dec 2024 07:54:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
88072024-12-21T07:54:24.004ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
88082024-12-21T07:54:24.005ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "11f7614f-4ec6-41ca-a873-51cfe4ad1973", "date": "Sat, 21 Dec 2024 07:54:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
88092024-12-21T07:54:24.005ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
88102024-12-21T07:54:24.007ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
88112024-12-21T07:54:24.007ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 497.91364ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
88122024-12-21T07:54:24.013ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
88132024-12-21T07:54:24.013ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "59b8b213-4383-46b5-9d78-6832e8a9208d", "date": "Sat, 21 Dec 2024 07:54:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
88142024-12-21T07:54:24.013ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
88152024-12-21T07:54:24.015ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f9596cd0-9a95-4a77-9be1-7e6e71ef7254", "date": "Sat, 21 Dec 2024 07:54:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
88162024-12-21T07:54:24.015ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
88172024-12-21T07:54:24.017ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "cb9a8a1d-5b27-4196-bb84-0b1a7cbec83a", "date": "Sat, 21 Dec 2024 07:54:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
88182024-12-21T07:54:24.017ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
88192024-12-21T07:54:24.018ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
88202024-12-21T07:54:24.018ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
88212024-12-21T07:54:24.019ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
88222024-12-21T07:54:24.019ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 510.369643ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
88232024-12-21T07:54:24.021ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88242024-12-21T07:54:24.021ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 512.270966ms iteration = 15 status = null
88252024-12-21T07:54:24.023ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
88262024-12-21T07:54:24.023ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88272024-12-21T07:54:24.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88282024-12-21T07:54:24.024ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 515.042534ms iteration = 15 status = {}
88292024-12-21T07:54:24.026ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
88302024-12-21T07:54:24.026ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
88312024-12-21T07:54:24.026ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 07:47:23.936594 UTC dns_group = internal generation = 1
88322024-12-21T07:54:24.026ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 518.660116ms iteration = 9 status = {"generation":1}
88332024-12-21T07:54:24.058ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "29cefc91-16a1-4cbd-8691-d73c0ea5cdd1", "content-length": "372", "date": "Sat, 21 Dec 2024 07:54:23 GMT"} })
88342024-12-21T07:54:24.059ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88352024-12-21T07:54:24.059ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1362021-a831-4050-8d9a-e6d1dabe94e3", "content-length": "691", "date": "Sat, 21 Dec 2024 07:54:24 GMT"} })
88362024-12-21T07:54:24.059ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
88372024-12-21T07:54:24.059ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
88382024-12-21T07:54:24.059ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
88392024-12-21T07:54:24.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88402024-12-21T07:54:24.060ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 551.463418ms iteration = 15 status = {}
88412024-12-21T07:54:24.073ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
88422024-12-21T07:54:24.073ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
88432024-12-21T07:54:24.105ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88442024-12-21T07:54:24.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88452024-12-21T07:54:24.107ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
88462024-12-21T07:54:24.107ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88472024-12-21T07:54:24.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88482024-12-21T07:54:24.116ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
88492024-12-21T07:54:24.116ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9853c8e-c0a1-4693-af92-d9ba7745d82d", "content-length": "134", "date": "Sat, 21 Dec 2024 07:54:24 GMT"} })
88502024-12-21T07:54:24.116ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
88512024-12-21T07:54:24.116ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
88522024-12-21T07:54:24.117ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
88532024-12-21T07:54:24.117ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
88542024-12-21T07:54:24.117ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
88552024-12-21T07:54:24.117ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
88562024-12-21T07:54:24.117ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
88572024-12-21T07:54:24.117ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
88582024-12-21T07:54:24.117ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
88592024-12-21T07:54:24.117ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
88602024-12-21T07:54:24.117ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
88612024-12-21T07:54:24.117ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88622024-12-21T07:54:24.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88632024-12-21T07:54:24.119ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
88642024-12-21T07:54:24.120ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "109e2990-403f-4a76-934e-5f9257a40e5c", "content-length": "2", "date": "Sat, 21 Dec 2024 07:54:24 GMT"} })
88652024-12-21T07:54:24.120ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
88662024-12-21T07:54:24.120ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b9315e3-13b5-4d53-a43b-e4652fe73fb0", "content-length": "52", "date": "Sat, 21 Dec 2024 07:54:24 GMT"} })
88672024-12-21T07:54:24.120ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
88682024-12-21T07:54:24.120ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
88692024-12-21T07:54:24.162ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f6476965-313b-4347-ba33-654a7cb8fb8d", "date": "Sat, 21 Dec 2024 07:54:24 GMT"} })
88702024-12-21T07:54:24.162ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88712024-12-21T07:54:24.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88722024-12-21T07:54:24.165ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88732024-12-21T07:54:24.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88742024-12-21T07:54:24.168ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88752024-12-21T07:54:24.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88762024-12-21T07:54:24.171ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
88772024-12-21T07:54:24.171ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
88782024-12-21T07:54:24.171ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2c185749-6e44-495e-bf6c-6a3e0d996c04", "date": "Sat, 21 Dec 2024 07:54:24 GMT"} })
88792024-12-21T07:54:24.173ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 664.103661ms iteration = 16 status = {}
88802024-12-21T07:54:24.253ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d14d9a63-6697-4331-87d6-dfd4eaf2cbc6", "date": "Sat, 21 Dec 2024 07:54:24 GMT"} })
88812024-12-21T07:54:24.253ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
88822024-12-21T07:54:24.253ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
88832024-12-21T07:54:24.254ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3607c47d-14a0-4038-aff1-96c93f3d149f", "content-length": "682", "date": "Sat, 21 Dec 2024 07:54:24 GMT"} })
88842024-12-21T07:54:24.254ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88852024-12-21T07:54:24.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88862024-12-21T07:54:24.258ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88872024-12-21T07:54:24.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88882024-12-21T07:54:24.260ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88892024-12-21T07:54:24.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88902024-12-21T07:54:24.262ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88912024-12-21T07:54:24.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88922024-12-21T07:54:24.269ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 760.510814ms iteration = 15 status = {}
88932024-12-21T07:54:24.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 0cc52926-c5bb-4580-bba5-c7d9d1afb5a7 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
88942024-12-21T07:54:24.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 0cc52926-c5bb-4580-bba5-c7d9d1afb5a7 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
88952024-12-21T07:54:24.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2696 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 0cc52926-c5bb-4580-bba5-c7d9d1afb5a7 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
88962024-12-21T07:54:25.899ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1197 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = eea9b1a3-78cc-40d8-b4d6-91839c9c06cf response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
88972024-12-21T07:54:33.508ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
88982024-12-21T07:54:33.509ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
88992024-12-21T07:54:33.509ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89002024-12-21T07:54:33.509ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89012024-12-21T07:54:33.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89022024-12-21T07:54:33.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89032024-12-21T07:54:33.511ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89042024-12-21T07:54:33.514ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
89052024-12-21T07:54:33.514ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89062024-12-21T07:54:33.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89072024-12-21T07:54:33.516ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89082024-12-21T07:54:33.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89092024-12-21T07:54:33.517ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89102024-12-21T07:54:33.520ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
89112024-12-21T07:54:33.520ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89122024-12-21T07:54:33.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89132024-12-21T07:54:33.532ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
89142024-12-21T07:54:33.532ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.539594ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
89152024-12-21T07:54:33.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89162024-12-21T07:54:33.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89172024-12-21T07:54:33.575ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.058303ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
89182024-12-21T07:54:35.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = b8a69fae-70d3-43f7-8cd5-9a262bb49f0f roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
89192024-12-21T07:54:35.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = b8a69fae-70d3-43f7-8cd5-9a262bb49f0f resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
89202024-12-21T07:54:35.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2839 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = b8a69fae-70d3-43f7-8cd5-9a262bb49f0f response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
89212024-12-21T07:54:35.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = aaf18ab5-5a2b-4f42-be8d-ef3adff79f10 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
89222024-12-21T07:54:35.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = aaf18ab5-5a2b-4f42-be8d-ef3adff79f10 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
89232024-12-21T07:54:35.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2179 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = aaf18ab5-5a2b-4f42-be8d-ef3adff79f10 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
89242024-12-21T07:54:35.899ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1212 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = a52b14a2-5b02-4f16-a481-5f4047ff3dea response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
89252024-12-21T07:54:43.508ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
89262024-12-21T07:54:43.509ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
89272024-12-21T07:54:43.509ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89282024-12-21T07:54:43.509ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89292024-12-21T07:54:43.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89302024-12-21T07:54:43.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89312024-12-21T07:54:43.510ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89322024-12-21T07:54:43.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89332024-12-21T07:54:43.511ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89342024-12-21T07:54:43.514ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
89352024-12-21T07:54:43.514ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89362024-12-21T07:54:43.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89372024-12-21T07:54:43.515ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89382024-12-21T07:54:43.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89392024-12-21T07:54:43.517ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89402024-12-21T07:54:43.519ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
89412024-12-21T07:54:43.519ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89422024-12-21T07:54:43.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89432024-12-21T07:54:43.531ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
89442024-12-21T07:54:43.531ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.614928ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
89452024-12-21T07:54:43.543ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.626014ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
89462024-12-21T07:54:45.900ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1229 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 99b753bc-96a2-41e4-941c-a5b8a44f3d99 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
89472024-12-21T07:54:50.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = a64d80ec-0e59-4367-9ebc-dab08c1f4d42 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
89482024-12-21T07:54:50.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = a64d80ec-0e59-4367-9ebc-dab08c1f4d42 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
89492024-12-21T07:54:50.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2788 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = a64d80ec-0e59-4367-9ebc-dab08c1f4d42 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
89502024-12-21T07:54:50.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 5006e5a3-5e4b-41be-9fc8-14ef866874f3 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
89512024-12-21T07:54:50.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 5006e5a3-5e4b-41be-9fc8-14ef866874f3 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
89522024-12-21T07:54:50.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2514 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 5006e5a3-5e4b-41be-9fc8-14ef866874f3 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
89532024-12-21T07:54:53.508ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
89542024-12-21T07:54:53.508ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
89552024-12-21T07:54:53.508ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
89562024-12-21T07:54:53.508ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89572024-12-21T07:54:53.508ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
89582024-12-21T07:54:53.508ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89592024-12-21T07:54:53.508ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
89602024-12-21T07:54:53.508ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
89612024-12-21T07:54:53.508ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
89622024-12-21T07:54:53.508ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
89632024-12-21T07:54:53.508ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
89642024-12-21T07:54:53.508ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89652024-12-21T07:54:53.508ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
89662024-12-21T07:54:53.508ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89672024-12-21T07:54:53.508ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
89682024-12-21T07:54:53.508ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89692024-12-21T07:54:53.508ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
89702024-12-21T07:54:53.508ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
89712024-12-21T07:54:53.508ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
89722024-12-21T07:54:53.508ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
89732024-12-21T07:54:53.508ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
89742024-12-21T07:54:53.509ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
89752024-12-21T07:54:53.509ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
89762024-12-21T07:54:53.509ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
89772024-12-21T07:54:53.509ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
89782024-12-21T07:54:53.509ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
89792024-12-21T07:54:53.509ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
89802024-12-21T07:54:53.509ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
89812024-12-21T07:54:53.509ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89822024-12-21T07:54:53.509ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89832024-12-21T07:54:53.509ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
89842024-12-21T07:54:53.509ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
89852024-12-21T07:54:53.509ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
89862024-12-21T07:54:53.509ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
89872024-12-21T07:54:53.509ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89882024-12-21T07:54:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89892024-12-21T07:54:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89902024-12-21T07:54:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89912024-12-21T07:54:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
89922024-12-21T07:54:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
89932024-12-21T07:54:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
89942024-12-21T07:54:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
89952024-12-21T07:54:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89962024-12-21T07:54:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89972024-12-21T07:54:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
89982024-12-21T07:54:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
89992024-12-21T07:54:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90002024-12-21T07:54:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90012024-12-21T07:54:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90022024-12-21T07:54:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
90032024-12-21T07:54:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
90042024-12-21T07:54:53.512ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.227925ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
90052024-12-21T07:54:53.515ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90062024-12-21T07:54:53.516ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90072024-12-21T07:54:53.518ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
90082024-12-21T07:54:53.518ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90092024-12-21T07:54:53.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90102024-12-21T07:54:53.520ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1413, tv_nsec: 469529976 } })
90112024-12-21T07:54:53.521ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
90122024-12-21T07:54:53.521ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
90132024-12-21T07:54:53.521ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90142024-12-21T07:54:53.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90152024-12-21T07:54:53.523ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90162024-12-21T07:54:53.524ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90172024-12-21T07:54:53.525ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
90182024-12-21T07:54:53.525ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
90192024-12-21T07:54:53.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
90202024-12-21T07:54:53.526ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
90212024-12-21T07:54:53.526ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90222024-12-21T07:54:53.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90232024-12-21T07:54:53.528ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90242024-12-21T07:54:53.530ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
90252024-12-21T07:54:53.530ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90262024-12-21T07:54:53.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90272024-12-21T07:54:53.530ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
90282024-12-21T07:54:53.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
90292024-12-21T07:54:53.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90302024-12-21T07:54:53.533ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90312024-12-21T07:54:53.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90322024-12-21T07:54:53.534ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90332024-12-21T07:54:53.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90342024-12-21T07:54:53.535ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
90352024-12-21T07:54:53.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90362024-12-21T07:54:53.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90372024-12-21T07:54:53.535ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1413, tv_nsec: 484611545 } })
90382024-12-21T07:54:53.536ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
90392024-12-21T07:54:53.536ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1413, tv_nsec: 485169335 } })
90402024-12-21T07:54:53.536ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
90412024-12-21T07:54:53.537ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90422024-12-21T07:54:53.540ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
90432024-12-21T07:54:53.540ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90442024-12-21T07:54:53.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90452024-12-21T07:54:53.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90462024-12-21T07:54:53.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90472024-12-21T07:54:53.564ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
90482024-12-21T07:54:53.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
90492024-12-21T07:54:53.569ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 61.21628ms iteration = 16 status = {"errors":[],"finish_invoked_ok":[]}
90502024-12-21T07:54:53.570ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 61.19388ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
90512024-12-21T07:54:53.571ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 63.058761ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
90522024-12-21T07:54:53.572ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90532024-12-21T07:54:53.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90542024-12-21T07:54:53.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90552024-12-21T07:54:53.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90562024-12-21T07:54:53.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
90572024-12-21T07:54:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
90582024-12-21T07:54:53.583ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90592024-12-21T07:54:53.583ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90602024-12-21T07:54:53.583ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
90612024-12-21T07:54:53.583ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
90622024-12-21T07:54:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90632024-12-21T07:54:53.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
90642024-12-21T07:54:53.586ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
90652024-12-21T07:54:53.586ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 77.54026ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
90662024-12-21T07:54:53.587ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90672024-12-21T07:54:53.587ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
90682024-12-21T07:54:53.587ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
90692024-12-21T07:54:53.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
90702024-12-21T07:54:53.589ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90712024-12-21T07:54:53.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
90722024-12-21T07:54:53.592ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90732024-12-21T07:54:53.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90742024-12-21T07:54:53.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90752024-12-21T07:54:53.600ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
90762024-12-21T07:54:53.600ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90772024-12-21T07:54:53.601ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1cc919fa-b6d6-4e35-9f10-8e168a4dfdfd", "content-length": "26", "date": "Sat, 21 Dec 2024 07:54:53 GMT"} })
90782024-12-21T07:54:53.601ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90792024-12-21T07:54:53.601ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
90802024-12-21T07:54:53.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90812024-12-21T07:54:53.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90822024-12-21T07:54:53.603ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
90832024-12-21T07:54:53.616ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
90842024-12-21T07:54:53.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
90852024-12-21T07:54:53.622ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
90862024-12-21T07:54:53.622ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 113.853603ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
90872024-12-21T07:54:53.626ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 117.19536ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
90882024-12-21T07:54:53.631ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 122.98237ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
90892024-12-21T07:54:53.634ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90902024-12-21T07:54:53.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
90912024-12-21T07:54:53.637ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90922024-12-21T07:54:53.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90932024-12-21T07:54:53.638ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90942024-12-21T07:54:53.638ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
90952024-12-21T07:54:53.639ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 130.00837ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
90962024-12-21T07:54:53.639ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 131.114948ms iteration = 16 status = 0
90972024-12-21T07:54:53.649ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
90982024-12-21T07:54:53.649ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90992024-12-21T07:54:53.649ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc9b40fa-a40c-4e42-84e5-8674ffe39403", "content-length": "26", "date": "Sat, 21 Dec 2024 07:54:53 GMT"} })
91002024-12-21T07:54:53.649ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
91012024-12-21T07:54:53.652ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
91022024-12-21T07:54:53.652ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 143.946329ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
91032024-12-21T07:54:53.679ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91042024-12-21T07:54:53.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91052024-12-21T07:54:53.683ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
91062024-12-21T07:54:53.684ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
91072024-12-21T07:54:53.684ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b05fef8-b9a1-4ca2-b477-5ba49b17e4ec", "content-length": "26", "date": "Sat, 21 Dec 2024 07:54:53 GMT"} })
91082024-12-21T07:54:53.684ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
91092024-12-21T07:54:53.686ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
91102024-12-21T07:54:53.720ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 211.907905ms iteration = 18 status = {"physical_disks_added":0}
91112024-12-21T07:54:53.751ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
91122024-12-21T07:54:53.752ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
91132024-12-21T07:54:53.752ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c1c125e-799b-4473-bc31-5a2bd9983424", "content-length": "372", "date": "Sat, 21 Dec 2024 07:54:53 GMT"} })
91142024-12-21T07:54:53.752ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91152024-12-21T07:54:53.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91162024-12-21T07:54:53.762ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
91172024-12-21T07:54:53.763ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1537ef3-a9dc-4de0-9d4b-e79bad38867b", "content-length": "1", "date": "Sat, 21 Dec 2024 07:54:53 GMT"} })
91182024-12-21T07:54:53.764ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
91192024-12-21T07:54:53.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
91202024-12-21T07:54:53.767ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 258.662047ms iteration = 16 status = null
91212024-12-21T07:54:53.785ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 276.761357ms iteration = 16 status = {}
91222024-12-21T07:54:53.804ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
91232024-12-21T07:54:53.804ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
91242024-12-21T07:54:53.805ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "804b7de2-7606-4458-a816-ed8265d61da2", "date": "Sat, 21 Dec 2024 07:54:53 GMT"} })
91252024-12-21T07:54:53.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91262024-12-21T07:54:53.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91272024-12-21T07:54:53.806ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91282024-12-21T07:54:53.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91292024-12-21T07:54:53.806ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91302024-12-21T07:54:53.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91312024-12-21T07:54:53.807ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91322024-12-21T07:54:53.809ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
91332024-12-21T07:54:53.809ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91342024-12-21T07:54:53.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91352024-12-21T07:54:53.810ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91362024-12-21T07:54:53.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91372024-12-21T07:54:53.811ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91382024-12-21T07:54:53.813ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
91392024-12-21T07:54:53.813ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
91402024-12-21T07:54:53.813ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
91412024-12-21T07:54:53.813ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91422024-12-21T07:54:53.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91432024-12-21T07:54:53.816ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b154d855-379a-4edd-bc50-6a3a77a706af", "date": "Sat, 21 Dec 2024 07:54:53 GMT"} })
91442024-12-21T07:54:53.818ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 309.918306ms iteration = 17 status = {}
91452024-12-21T07:54:53.841ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91462024-12-21T07:54:53.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91472024-12-21T07:54:53.843ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
91482024-12-21T07:54:53.843ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91492024-12-21T07:54:53.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91502024-12-21T07:54:53.853ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
91512024-12-21T07:54:53.853ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b8ab5c2-8f18-4147-a36b-e1ab79856712", "content-length": "134", "date": "Sat, 21 Dec 2024 07:54:53 GMT"} })
91522024-12-21T07:54:53.853ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
91532024-12-21T07:54:53.853ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
91542024-12-21T07:54:53.854ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
91552024-12-21T07:54:53.854ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
91562024-12-21T07:54:53.854ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91572024-12-21T07:54:53.854ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91582024-12-21T07:54:53.854ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91592024-12-21T07:54:53.854ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
91602024-12-21T07:54:53.854ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91612024-12-21T07:54:53.854ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
91622024-12-21T07:54:53.854ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
91632024-12-21T07:54:53.854ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91642024-12-21T07:54:53.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91652024-12-21T07:54:53.856ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
91662024-12-21T07:54:53.857ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "23275d9a-5ca9-4c0e-b521-4336eed5ebbc", "content-length": "2", "date": "Sat, 21 Dec 2024 07:54:53 GMT"} })
91672024-12-21T07:54:53.857ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
91682024-12-21T07:54:53.857ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8675b5e0-6a37-44ce-a249-efb08dae3c71", "content-length": "52", "date": "Sat, 21 Dec 2024 07:54:53 GMT"} })
91692024-12-21T07:54:53.857ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
91702024-12-21T07:54:53.857ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
91712024-12-21T07:54:53.900ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
91722024-12-21T07:54:53.948ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "20c76d15-158d-4b7e-97b0-b707d5e172eb", "content-length": "691", "date": "Sat, 21 Dec 2024 07:54:53 GMT"} })
91732024-12-21T07:54:53.948ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
91742024-12-21T07:54:53.948ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
91752024-12-21T07:54:53.948ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
91762024-12-21T07:54:53.949ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 440.726999ms iteration = 16 status = {}
91772024-12-21T07:54:54.044ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ee49dca1-7728-46d7-bf34-9119ad7f587b", "date": "Sat, 21 Dec 2024 07:54:53 GMT"} })
91782024-12-21T07:54:54.044ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
91792024-12-21T07:54:54.044ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
91802024-12-21T07:54:54.047ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b61ab926-0187-4231-976f-f272aa52c4d3", "content-length": "682", "date": "Sat, 21 Dec 2024 07:54:53 GMT"} })
91812024-12-21T07:54:54.047ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91822024-12-21T07:54:54.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91832024-12-21T07:54:54.051ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91842024-12-21T07:54:54.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91852024-12-21T07:54:54.054ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91862024-12-21T07:54:54.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91872024-12-21T07:54:54.056ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91882024-12-21T07:54:54.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91892024-12-21T07:54:54.063ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 554.779636ms iteration = 16 status = {}
91902024-12-21T07:54:54.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = dde1e942-7e4d-4061-baa3-1892a769cdd9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
91912024-12-21T07:54:54.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = dde1e942-7e4d-4061-baa3-1892a769cdd9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
91922024-12-21T07:54:54.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2835 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = dde1e942-7e4d-4061-baa3-1892a769cdd9 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
91932024-12-21T07:54:55.900ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1253 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = cd90a2e5-5bad-4a1d-8215-9c14504437b8 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
91942024-12-21T07:54:56.210ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:42502
91952024-12-21T07:54:56.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42502 req_id = d178ec47-495d-48b1-9555-db22426dc11d roles = RoleSet { roles: {} } uri = /metrics/producers
91962024-12-21T07:54:56.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42502 req_id = d178ec47-495d-48b1-9555-db22426dc11d resource = Database result = Ok(()) uri = /metrics/producers
91972024-12-21T07:54:56.252ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = b2e6180f-2896-4592-b155-f5ca3f904fa7
91982024-12-21T07:54:56.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42255 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42502 req_id = d178ec47-495d-48b1-9555-db22426dc11d response_code = 201 uri = /metrics/producers
91992024-12-21T07:54:56.388ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
92002024-12-21T07:54:56.388ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
92012024-12-21T07:54:56.418ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
92022024-12-21T07:54:56.418ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:60722
92032024-12-21T07:54:56.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60722 req_id = 91be76b5-0416-4402-9149-cc119b599945 roles = RoleSet { roles: {} } uri = /metrics/producers
92042024-12-21T07:54:56.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60722 req_id = 91be76b5-0416-4402-9149-cc119b599945 resource = Database result = Ok(()) uri = /metrics/producers
92052024-12-21T07:54:56.453ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
92062024-12-21T07:54:56.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34254 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60722 req_id = 91be76b5-0416-4402-9149-cc119b599945 response_code = 201 uri = /metrics/producers
92072024-12-21T07:54:56.453ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "91be76b5-0416-4402-9149-cc119b599945", "content-length": "41", "date": "Sat, 21 Dec 2024 07:54:56 GMT"} })
92082024-12-21T07:54:56.455ZDEBGnexus (producer-registration-task): registered with nexus successfully
92092024-12-21T07:54:56.455ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
92102024-12-21T07:55:03.508ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
92112024-12-21T07:55:03.508ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
92122024-12-21T07:55:03.509ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92132024-12-21T07:55:03.509ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92142024-12-21T07:55:03.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92152024-12-21T07:55:03.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92162024-12-21T07:55:03.510ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92172024-12-21T07:55:03.511ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92182024-12-21T07:55:03.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92192024-12-21T07:55:03.513ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.161431ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
92202024-12-21T07:55:03.513ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92212024-12-21T07:55:03.513ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92222024-12-21T07:55:03.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92232024-12-21T07:55:03.515ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92242024-12-21T07:55:03.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92252024-12-21T07:55:03.516ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92262024-12-21T07:55:03.518ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
92272024-12-21T07:55:03.518ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92282024-12-21T07:55:03.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92292024-12-21T07:55:03.530ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
92302024-12-21T07:55:03.530ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.722572ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
92312024-12-21T07:55:05.900ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1119 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = e06f8b92-0100-47f5-8376-57949c798da8 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
92322024-12-21T07:55:11.017ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:49347
92332024-12-21T07:55:11.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0eb42ec5-1579-4e4a-ac1a-ddfb03524d51 roles = RoleSet { roles: {} } uri = /metrics/producers
92342024-12-21T07:55:11.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0eb42ec5-1579-4e4a-ac1a-ddfb03524d51 resource = Database result = Ok(()) uri = /metrics/producers
92352024-12-21T07:55:11.096ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = 42bd0fec-23e2-48f9-bdad-7989f94730a0
92362024-12-21T07:55:11.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79010 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0eb42ec5-1579-4e4a-ac1a-ddfb03524d51 response_code = 201 uri = /metrics/producers
92372024-12-21T07:55:13.509ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
92382024-12-21T07:55:13.510ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
92392024-12-21T07:55:13.510ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92402024-12-21T07:55:13.510ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92412024-12-21T07:55:13.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92422024-12-21T07:55:13.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92432024-12-21T07:55:13.512ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92442024-12-21T07:55:13.514ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92452024-12-21T07:55:13.514ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92462024-12-21T07:55:13.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92472024-12-21T07:55:13.515ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92482024-12-21T07:55:13.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92492024-12-21T07:55:13.517ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92502024-12-21T07:55:13.519ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
92512024-12-21T07:55:13.519ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92522024-12-21T07:55:13.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92532024-12-21T07:55:13.530ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
92542024-12-21T07:55:13.530ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.733486ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
92552024-12-21T07:55:13.545ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92562024-12-21T07:55:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92572024-12-21T07:55:13.547ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.127226ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
92582024-12-21T07:55:15.657ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:54957
92592024-12-21T07:55:15.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54957 req_id = 6229026b-fc68-4d24-be3d-c323bf22f4ee roles = RoleSet { roles: {} } uri = /metrics/producers
92602024-12-21T07:55:15.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54957 req_id = 6229026b-fc68-4d24-be3d-c323bf22f4ee resource = Database result = Ok(()) uri = /metrics/producers
92612024-12-21T07:55:15.675ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = cae81b8e-6ade-45fa-953a-26f79465611b
92622024-12-21T07:55:15.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 17568 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54957 req_id = 6229026b-fc68-4d24-be3d-c323bf22f4ee response_code = 201 uri = /metrics/producers
92632024-12-21T07:55:15.899ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1095 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = ee2e2a40-d0e9-4f24-95e4-c57a19a5a3aa response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
92642024-12-21T07:55:20.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = aeedae54-3dd3-4f9b-acde-1fa97af2b6d1 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
92652024-12-21T07:55:20.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = aeedae54-3dd3-4f9b-acde-1fa97af2b6d1 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
92662024-12-21T07:55:20.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3572 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = aeedae54-3dd3-4f9b-acde-1fa97af2b6d1 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
92672024-12-21T07:55:20.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = d8c84701-c2b9-49cd-a815-e8bfb0f288a5 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
92682024-12-21T07:55:20.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = d8c84701-c2b9-49cd-a815-e8bfb0f288a5 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
92692024-12-21T07:55:20.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2665 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = d8c84701-c2b9-49cd-a815-e8bfb0f288a5 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
92702024-12-21T07:55:23.508ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
92712024-12-21T07:55:23.508ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
92722024-12-21T07:55:23.508ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92732024-12-21T07:55:23.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92742024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
92752024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
92762024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
92772024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
92782024-12-21T07:55:23.509ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
92792024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
92802024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
92812024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
92822024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
92832024-12-21T07:55:23.509ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 3f45718f-9869-448a-a087-788e66db5e9d
92842024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 24.381\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"3f45718f-9869-448a-a087-788e66db5e9d"}
92852024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92862024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
92872024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
92882024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
92892024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
92902024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92912024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
92922024-12-21T07:55:23.509ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:45:23.509204692 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
92932024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
92942024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
92952024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
92962024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
92972024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
92982024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
92992024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
93002024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
93012024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
93022024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
93032024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
93042024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
93052024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
93062024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
93072024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
93082024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
93092024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93102024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
93112024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
93122024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
93132024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
93142024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93152024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
93162024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
93172024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93182024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93192024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
93202024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
93212024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
93222024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
93232024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
93242024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
93252024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
93262024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
93272024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93282024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
93292024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
93302024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
93312024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
93322024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
93332024-12-21T07:55:23.509ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
93342024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93352024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93362024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
93372024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
93382024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
93392024-12-21T07:55:23.509ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("481de7e8-0737-474b-8c33-e6e8bc6477be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("683a9892-43cd-4dd8-a983-26cccd988df0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1443, tv_nsec: 458193812 } })
93402024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
93412024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93422024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
93432024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
93442024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
93452024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93462024-12-21T07:55:23.509ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1595c632-cfae-4f6b-937d-d413dd8cf0b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1443, tv_nsec: 458320944 } })
93472024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93482024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
93492024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93502024-12-21T07:55:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
93512024-12-21T07:55:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93522024-12-21T07:55:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
93532024-12-21T07:55:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93542024-12-21T07:55:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
93552024-12-21T07:55:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
93562024-12-21T07:55:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
93572024-12-21T07:55:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
93582024-12-21T07:55:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93592024-12-21T07:55:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93602024-12-21T07:55:23.510ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
93612024-12-21T07:55:23.510ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.073859ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
93622024-12-21T07:55:23.510ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
93632024-12-21T07:55:23.510ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.353883ms iteration = 10 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
93642024-12-21T07:55:23.514ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 5.423933ms iteration = 17 status = {"errors":[],"finish_invoked_ok":[]}
93652024-12-21T07:55:23.520ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93662024-12-21T07:55:23.524ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
93672024-12-21T07:55:23.524ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93682024-12-21T07:55:23.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93692024-12-21T07:55:23.527ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
93702024-12-21T07:55:23.527ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1443, tv_nsec: 475990898 } })
93712024-12-21T07:55:23.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
93722024-12-21T07:55:23.527ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:45:23.509204692 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
93732024-12-21T07:55:23.527ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 18.62031ms iteration = 9 status = {"expiration":"2024-12-21T07:45:23.509204692Z","pruned":[]}
93742024-12-21T07:55:23.527ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
93752024-12-21T07:55:23.529ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 19.719228ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
93762024-12-21T07:55:23.530ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.245325ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
93772024-12-21T07:55:23.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93782024-12-21T07:55:23.536ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93792024-12-21T07:55:23.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
93802024-12-21T07:55:23.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93812024-12-21T07:55:23.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93822024-12-21T07:55:23.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
93832024-12-21T07:55:23.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
93842024-12-21T07:55:23.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
93852024-12-21T07:55:23.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
93862024-12-21T07:55:23.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
93872024-12-21T07:55:23.542ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 32.956975ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
93882024-12-21T07:55:23.543ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93892024-12-21T07:55:23.543ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93902024-12-21T07:55:23.544ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1443, tv_nsec: 492528551 } })
93912024-12-21T07:55:23.544ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
93922024-12-21T07:55:23.544ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93932024-12-21T07:55:23.546ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
93942024-12-21T07:55:23.546ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
93952024-12-21T07:55:23.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
93962024-12-21T07:55:23.547ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
93972024-12-21T07:55:23.547ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93982024-12-21T07:55:23.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93992024-12-21T07:55:23.548ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94002024-12-21T07:55:23.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
94012024-12-21T07:55:23.549ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94022024-12-21T07:55:23.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94032024-12-21T07:55:23.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94042024-12-21T07:55:23.550ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
94052024-12-21T07:55:23.550ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
94062024-12-21T07:55:23.550ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
94072024-12-21T07:55:23.550ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
94082024-12-21T07:55:23.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94092024-12-21T07:55:23.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
94102024-12-21T07:55:23.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
94112024-12-21T07:55:23.554ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
94122024-12-21T07:55:23.554ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
94132024-12-21T07:55:23.554ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
94142024-12-21T07:55:23.554ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
94152024-12-21T07:55:23.554ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94162024-12-21T07:55:23.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
94172024-12-21T07:55:23.555ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94182024-12-21T07:55:23.555ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
94192024-12-21T07:55:23.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
94202024-12-21T07:55:23.556ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94212024-12-21T07:55:23.557ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
94222024-12-21T07:55:23.557ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94232024-12-21T07:55:23.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94242024-12-21T07:55:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
94252024-12-21T07:55:23.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94262024-12-21T07:55:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94272024-12-21T07:55:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
94282024-12-21T07:55:23.560ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
94292024-12-21T07:55:23.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
94302024-12-21T07:55:23.563ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94312024-12-21T07:55:23.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
94322024-12-21T07:55:23.566ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
94332024-12-21T07:55:23.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
94342024-12-21T07:55:23.579ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
94352024-12-21T07:55:23.579ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
94362024-12-21T07:55:23.579ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 70.54867ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
94372024-12-21T07:55:23.585ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94382024-12-21T07:55:23.586ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
94392024-12-21T07:55:23.586ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 77.741364ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
94402024-12-21T07:55:23.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
94412024-12-21T07:55:23.588ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
94422024-12-21T07:55:23.588ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
94432024-12-21T07:55:23.588ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
94442024-12-21T07:55:23.588ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
94452024-12-21T07:55:23.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
94462024-12-21T07:55:23.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
94472024-12-21T07:55:23.589ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94482024-12-21T07:55:23.593ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
94492024-12-21T07:55:23.593ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94502024-12-21T07:55:23.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94512024-12-21T07:55:23.595ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
94522024-12-21T07:55:23.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
94532024-12-21T07:55:23.599ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94542024-12-21T07:55:23.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94552024-12-21T07:55:23.600ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 91.332636ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
94562024-12-21T07:55:23.600ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94572024-12-21T07:55:23.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
94582024-12-21T07:55:23.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
94592024-12-21T07:55:23.603ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
94602024-12-21T07:55:23.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
94612024-12-21T07:55:23.603ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94622024-12-21T07:55:23.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94632024-12-21T07:55:23.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
94642024-12-21T07:55:23.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94652024-12-21T07:55:23.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94662024-12-21T07:55:23.606ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 97.129976ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
94672024-12-21T07:55:23.608ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1443, tv_nsec: 557000037 } })
94682024-12-21T07:55:23.609ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
94692024-12-21T07:55:23.619ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
94702024-12-21T07:55:23.619ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 109.776453ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
94712024-12-21T07:55:23.622ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94722024-12-21T07:55:23.628ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
94732024-12-21T07:55:23.628ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94742024-12-21T07:55:23.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94752024-12-21T07:55:23.637ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
94762024-12-21T07:55:23.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
94772024-12-21T07:55:23.637ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
94782024-12-21T07:55:23.640ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94792024-12-21T07:55:23.643ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
94802024-12-21T07:55:23.643ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
94812024-12-21T07:55:23.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
94822024-12-21T07:55:23.655ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
94832024-12-21T07:55:23.655ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 0 version = 2
94842024-12-21T07:55:23.655ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
94852024-12-21T07:55:23.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
94862024-12-21T07:55:23.663ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
94872024-12-21T07:55:23.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
94882024-12-21T07:55:23.668ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94892024-12-21T07:55:23.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
94902024-12-21T07:55:23.672ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
94912024-12-21T07:55:23.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
94922024-12-21T07:55:23.675ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
94932024-12-21T07:55:23.675ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
94942024-12-21T07:55:23.675ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
94952024-12-21T07:55:23.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
94962024-12-21T07:55:23.676ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
94972024-12-21T07:55:23.676ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
94982024-12-21T07:55:23.676ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 167.511954ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
94992024-12-21T07:55:23.690ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 181.432662ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
95002024-12-21T07:55:23.692ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 182.911048ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
95012024-12-21T07:55:23.693ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
95022024-12-21T07:55:23.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
95032024-12-21T07:55:23.697ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
95042024-12-21T07:55:23.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
95052024-12-21T07:55:23.718ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:47:21.583817Z, time_modified: 2024-12-21T07:47:21.583817Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }) }
95062024-12-21T07:55:23.718ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 208.815292ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]}},"default_endpoint":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
95072024-12-21T07:55:23.720ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95082024-12-21T07:55:23.724ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
95092024-12-21T07:55:23.724ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
95102024-12-21T07:55:23.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
95112024-12-21T07:55:23.726ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 1 version = 2
95122024-12-21T07:55:23.726ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
95132024-12-21T07:55:23.726ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 07:47:25.290148 UTC dns_group = external generation = 2
95142024-12-21T07:55:23.726ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 217.475201ms iteration = 10 status = {"generation":2}
95152024-12-21T07:55:23.731ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
95162024-12-21T07:55:23.731ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
95172024-12-21T07:55:23.731ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
95182024-12-21T07:55:23.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
95192024-12-21T07:55:23.734ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
95202024-12-21T07:55:23.734ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
95212024-12-21T07:55:23.735ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "869f388b-2441-42fe-954c-1f4738edc2e9", "content-length": "26", "date": "Sat, 21 Dec 2024 07:55:23 GMT"} })
95222024-12-21T07:55:23.735ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
95232024-12-21T07:55:23.738ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
95242024-12-21T07:55:23.743ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95252024-12-21T07:55:23.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95262024-12-21T07:55:23.750ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
95272024-12-21T07:55:23.750ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
95282024-12-21T07:55:23.750ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 241.109955ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
95292024-12-21T07:55:23.751ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95302024-12-21T07:55:23.755ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
95312024-12-21T07:55:23.755ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
95322024-12-21T07:55:23.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
95332024-12-21T07:55:23.759ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
95342024-12-21T07:55:23.778ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
95352024-12-21T07:55:23.778ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
95362024-12-21T07:55:23.778ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "db7fc9db-705b-4eee-bbb4-136cff80175d", "content-length": "26", "date": "Sat, 21 Dec 2024 07:55:23 GMT"} })
95372024-12-21T07:55:23.778ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
95382024-12-21T07:55:23.780ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
95392024-12-21T07:55:23.791ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 282.065818ms iteration = 19 status = {"physical_disks_added":0}
95402024-12-21T07:55:23.805ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
95412024-12-21T07:55:23.805ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 296.095518ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
95422024-12-21T07:55:23.819ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
95432024-12-21T07:55:23.867ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
95442024-12-21T07:55:23.867ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
95452024-12-21T07:55:23.867ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d908e51d-b6f5-44aa-beb6-da06fbb2dc57", "content-length": "26", "date": "Sat, 21 Dec 2024 07:55:23 GMT"} })
95462024-12-21T07:55:23.867ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
95472024-12-21T07:55:23.869ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
95482024-12-21T07:55:23.887ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
95492024-12-21T07:55:23.887ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
95502024-12-21T07:55:23.888ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca816172-c3f8-45b3-af37-6ce2f3741356", "content-length": "372", "date": "Sat, 21 Dec 2024 07:55:23 GMT"} })
95512024-12-21T07:55:23.888ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95522024-12-21T07:55:23.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95532024-12-21T07:55:23.889ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95542024-12-21T07:55:23.890ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 381.560615ms iteration = 17 status = 0
95552024-12-21T07:55:23.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
95562024-12-21T07:55:23.892ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
95572024-12-21T07:55:23.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
95582024-12-21T07:55:23.895ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
95592024-12-21T07:55:23.895ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
95602024-12-21T07:55:23.895ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 07:47:23.936594 UTC dns_group = internal generation = 1
95612024-12-21T07:55:23.895ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 387.344353ms iteration = 10 status = {"generation":1}
95622024-12-21T07:55:23.904ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
95632024-12-21T07:55:23.904ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "34b21622-2862-4ad1-a2c4-d83a76f89e28", "content-length": "1", "date": "Sat, 21 Dec 2024 07:55:23 GMT"} })
95642024-12-21T07:55:23.905ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
95652024-12-21T07:55:23.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
95662024-12-21T07:55:23.907ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 398.396353ms iteration = 17 status = null
95672024-12-21T07:55:23.942ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
95682024-12-21T07:55:23.942ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
95692024-12-21T07:55:23.942ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "11a527b1-fb7c-453b-8bd4-b37347239610", "date": "Sat, 21 Dec 2024 07:55:23 GMT"} })
95702024-12-21T07:55:23.942ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95712024-12-21T07:55:23.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95722024-12-21T07:55:23.944ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95732024-12-21T07:55:23.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95742024-12-21T07:55:23.949ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95752024-12-21T07:55:23.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95762024-12-21T07:55:23.953ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
95772024-12-21T07:55:23.953ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
95782024-12-21T07:55:23.953ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
95792024-12-21T07:55:23.953ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7fd60924-6b11-4828-9f21-758dc2af1616", "date": "Sat, 21 Dec 2024 07:55:23 GMT"} })
95802024-12-21T07:55:23.954ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "0be3f280-c1d1-4a23-866d-30476f794a8d", "date": "Sat, 21 Dec 2024 07:55:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
95812024-12-21T07:55:23.954ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
95822024-12-21T07:55:23.956ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 446.58504ms iteration = 18 status = {}
95832024-12-21T07:55:23.956ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "852be7ec-24a1-418d-b5bb-5caa8074b659", "date": "Sat, 21 Dec 2024 07:55:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
95842024-12-21T07:55:23.956ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
95852024-12-21T07:55:23.958ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
95862024-12-21T07:55:23.958ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 448.864239ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
95872024-12-21T07:55:23.960ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
95882024-12-21T07:55:23.961ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "b75d4c1a-ac5d-42ad-8f0b-33299b80b9fa", "date": "Sat, 21 Dec 2024 07:55:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
95892024-12-21T07:55:23.961ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
95902024-12-21T07:55:23.963ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "5d91dc56-39b9-4574-b44b-b278d562ea67", "date": "Sat, 21 Dec 2024 07:55:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
95912024-12-21T07:55:23.963ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
95922024-12-21T07:55:23.965ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "f6023d66-e15f-48bb-902a-10754b22cfd9", "date": "Sat, 21 Dec 2024 07:55:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
95932024-12-21T07:55:23.965ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
95942024-12-21T07:55:23.967ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
95952024-12-21T07:55:23.967ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 458.142058ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
95962024-12-21T07:55:23.973ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 464.10874ms iteration = 17 status = {}
95972024-12-21T07:55:23.990ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95982024-12-21T07:55:23.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95992024-12-21T07:55:23.991ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96002024-12-21T07:55:23.993ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
96012024-12-21T07:55:23.993ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
96022024-12-21T07:55:23.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
96032024-12-21T07:55:23.994ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96042024-12-21T07:55:23.996ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
96052024-12-21T07:55:23.996ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
96062024-12-21T07:55:23.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
96072024-12-21T07:55:24.016ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96082024-12-21T07:55:24.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96092024-12-21T07:55:24.018ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
96102024-12-21T07:55:24.018ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96112024-12-21T07:55:24.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96122024-12-21T07:55:24.027ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
96132024-12-21T07:55:24.028ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f606410-fda6-412a-a0b1-c8e67cf8230e", "content-length": "134", "date": "Sat, 21 Dec 2024 07:55:24 GMT"} })
96142024-12-21T07:55:24.028ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
96152024-12-21T07:55:24.028ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
96162024-12-21T07:55:24.028ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
96172024-12-21T07:55:24.028ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
96182024-12-21T07:55:24.028ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
96192024-12-21T07:55:24.028ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
96202024-12-21T07:55:24.028ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
96212024-12-21T07:55:24.028ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
96222024-12-21T07:55:24.028ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
96232024-12-21T07:55:24.028ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
96242024-12-21T07:55:24.028ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
96252024-12-21T07:55:24.028ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96262024-12-21T07:55:24.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96272024-12-21T07:55:24.031ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
96282024-12-21T07:55:24.031ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "37eaecc3-9585-4fcd-9281-8349eae81c6f", "content-length": "2", "date": "Sat, 21 Dec 2024 07:55:24 GMT"} })
96292024-12-21T07:55:24.031ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
96302024-12-21T07:55:24.031ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e450b0b0-78f9-441c-a4f4-ff204983b793", "content-length": "52", "date": "Sat, 21 Dec 2024 07:55:24 GMT"} })
96312024-12-21T07:55:24.031ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
96322024-12-21T07:55:24.031ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
96332024-12-21T07:55:24.084ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
96342024-12-21T07:55:24.133ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "718a9c45-48fd-4865-823b-987957064d88", "date": "Sat, 21 Dec 2024 07:55:23 GMT"} })
96352024-12-21T07:55:24.133ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
96362024-12-21T07:55:24.133ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
96372024-12-21T07:55:24.133ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ffc3a52-425e-4bde-8251-2a283b93d7a9", "content-length": "682", "date": "Sat, 21 Dec 2024 07:55:24 GMT"} })
96382024-12-21T07:55:24.134ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96392024-12-21T07:55:24.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96402024-12-21T07:55:24.134ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "56bdb36b-3b11-42b6-b4f1-55f7e6912ee4", "content-length": "691", "date": "Sat, 21 Dec 2024 07:55:24 GMT"} })
96412024-12-21T07:55:24.134ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
96422024-12-21T07:55:24.134ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
96432024-12-21T07:55:24.134ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
96442024-12-21T07:55:24.135ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 626.305992ms iteration = 17 status = {}
96452024-12-21T07:55:24.137ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96462024-12-21T07:55:24.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96472024-12-21T07:55:24.140ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96482024-12-21T07:55:24.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96492024-12-21T07:55:24.142ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96502024-12-21T07:55:24.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96512024-12-21T07:55:24.148ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 639.494919ms iteration = 17 status = {}
96522024-12-21T07:55:24.498ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:43713
96532024-12-21T07:55:24.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43713 req_id = cdcd5e9f-9222-4a6e-a55f-e6b8fab6f94a roles = RoleSet { roles: {} } uri = /metrics/producers
96542024-12-21T07:55:24.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43713 req_id = cdcd5e9f-9222-4a6e-a55f-e6b8fab6f94a resource = Database result = Ok(()) uri = /metrics/producers
96552024-12-21T07:55:24.542ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
96562024-12-21T07:55:24.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43648 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43713 req_id = cdcd5e9f-9222-4a6e-a55f-e6b8fab6f94a response_code = 201 uri = /metrics/producers
96572024-12-21T07:55:24.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = e17d0d83-8372-4b19-b094-ead01893ffc5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
96582024-12-21T07:55:24.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = e17d0d83-8372-4b19-b094-ead01893ffc5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
96592024-12-21T07:55:24.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2199 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = e17d0d83-8372-4b19-b094-ead01893ffc5 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
96602024-12-21T07:55:25.899ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1157 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 24270346-40ae-49a4-af6c-0e9c7ba98363 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
96612024-12-21T07:55:26.204ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:48641
96622024-12-21T07:55:26.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48641 req_id = 7340ab64-50b4-42c6-9308-97b9dcb26829 roles = RoleSet { roles: {} } uri = /metrics/producers
96632024-12-21T07:55:26.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48641 req_id = 7340ab64-50b4-42c6-9308-97b9dcb26829 resource = Database result = Ok(()) uri = /metrics/producers
96642024-12-21T07:55:26.245ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = 9ad898a3-6e9f-4617-bdb6-642b625a79d4
96652024-12-21T07:55:26.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40962 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48641 req_id = 7340ab64-50b4-42c6-9308-97b9dcb26829 response_code = 201 uri = /metrics/producers
96662024-12-21T07:55:33.509ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
96672024-12-21T07:55:33.509ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
96682024-12-21T07:55:33.509ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96692024-12-21T07:55:33.509ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96702024-12-21T07:55:33.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96712024-12-21T07:55:33.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96722024-12-21T07:55:33.511ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96732024-12-21T07:55:33.514ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
96742024-12-21T07:55:33.514ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96752024-12-21T07:55:33.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96762024-12-21T07:55:33.516ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96772024-12-21T07:55:33.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96782024-12-21T07:55:33.517ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96792024-12-21T07:55:33.520ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
96802024-12-21T07:55:33.520ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96812024-12-21T07:55:33.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96822024-12-21T07:55:33.534ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
96832024-12-21T07:55:33.534ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.744825ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
96842024-12-21T07:55:33.542ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96852024-12-21T07:55:33.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96862024-12-21T07:55:33.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.418377ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
96872024-12-21T07:55:33.835ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:36358
96882024-12-21T07:55:33.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36358 req_id = 450fa790-2f99-42a3-8ea0-3be7e9062e22 roles = RoleSet { roles: {} } uri = /metrics/producers
96892024-12-21T07:55:33.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36358 req_id = 450fa790-2f99-42a3-8ea0-3be7e9062e22 resource = Database result = Ok(()) uri = /metrics/producers
96902024-12-21T07:55:33.877ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = 34be787b-2c60-4915-afd0-2c1a7062ad84
96912024-12-21T07:55:33.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41619 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36358 req_id = 450fa790-2f99-42a3-8ea0-3be7e9062e22 response_code = 201 uri = /metrics/producers
96922024-12-21T07:55:35.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 57035968-be1c-4652-b67c-024081c7869d roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
96932024-12-21T07:55:35.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 57035968-be1c-4652-b67c-024081c7869d resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
96942024-12-21T07:55:35.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2970 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 57035968-be1c-4652-b67c-024081c7869d response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
96952024-12-21T07:55:35.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 774c20ff-fd37-4a2a-b2f4-f74954cb1dcf roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
96962024-12-21T07:55:35.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 774c20ff-fd37-4a2a-b2f4-f74954cb1dcf resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
96972024-12-21T07:55:35.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2031 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 774c20ff-fd37-4a2a-b2f4-f74954cb1dcf response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
96982024-12-21T07:55:35.900ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1081 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 77dfe03e-4080-4b91-b552-ee358bbcbaba response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
96992024-12-21T07:55:43.509ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
97002024-12-21T07:55:43.509ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
97012024-12-21T07:55:43.509ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97022024-12-21T07:55:43.509ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97032024-12-21T07:55:43.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97042024-12-21T07:55:43.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97052024-12-21T07:55:43.511ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97062024-12-21T07:55:43.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97072024-12-21T07:55:43.511ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97082024-12-21T07:55:43.512ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.314237ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
97092024-12-21T07:55:43.514ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
97102024-12-21T07:55:43.514ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97112024-12-21T07:55:43.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97122024-12-21T07:55:43.516ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97132024-12-21T07:55:43.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97142024-12-21T07:55:43.518ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97152024-12-21T07:55:43.520ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
97162024-12-21T07:55:43.520ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97172024-12-21T07:55:43.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97182024-12-21T07:55:43.529ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
97192024-12-21T07:55:43.529ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.299288ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
97202024-12-21T07:55:45.900ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1175 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 099c5395-09b3-46bb-939d-fbb1644d9565 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
97212024-12-21T07:55:53.509ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
97222024-12-21T07:55:53.509ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
97232024-12-21T07:55:53.509ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
97242024-12-21T07:55:53.509ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
97252024-12-21T07:55:53.509ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97262024-12-21T07:55:53.509ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97272024-12-21T07:55:53.509ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
97282024-12-21T07:55:53.509ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
97292024-12-21T07:55:53.509ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97302024-12-21T07:55:53.509ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
97312024-12-21T07:55:53.509ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
97322024-12-21T07:55:53.509ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
97332024-12-21T07:55:53.509ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97342024-12-21T07:55:53.509ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
97352024-12-21T07:55:53.509ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97362024-12-21T07:55:53.509ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97372024-12-21T07:55:53.509ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
97382024-12-21T07:55:53.509ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
97392024-12-21T07:55:53.509ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
97402024-12-21T07:55:53.509ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
97412024-12-21T07:55:53.509ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
97422024-12-21T07:55:53.509ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
97432024-12-21T07:55:53.509ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97442024-12-21T07:55:53.509ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
97452024-12-21T07:55:53.509ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
97462024-12-21T07:55:53.509ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97472024-12-21T07:55:53.509ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
97482024-12-21T07:55:53.509ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
97492024-12-21T07:55:53.509ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
97502024-12-21T07:55:53.509ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
97512024-12-21T07:55:53.509ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
97522024-12-21T07:55:53.509ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97532024-12-21T07:55:53.509ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
97542024-12-21T07:55:53.509ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
97552024-12-21T07:55:53.509ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
97562024-12-21T07:55:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97572024-12-21T07:55:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97582024-12-21T07:55:53.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
97592024-12-21T07:55:53.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
97602024-12-21T07:55:53.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97612024-12-21T07:55:53.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
97622024-12-21T07:55:53.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97632024-12-21T07:55:53.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97642024-12-21T07:55:53.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97652024-12-21T07:55:53.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97662024-12-21T07:55:53.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97672024-12-21T07:55:53.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97682024-12-21T07:55:53.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
97692024-12-21T07:55:53.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
97702024-12-21T07:55:53.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
97712024-12-21T07:55:53.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
97722024-12-21T07:55:53.511ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97732024-12-21T07:55:53.512ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97742024-12-21T07:55:53.512ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97752024-12-21T07:55:53.513ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.604402ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
97762024-12-21T07:55:53.515ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
97772024-12-21T07:55:53.515ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97782024-12-21T07:55:53.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97792024-12-21T07:55:53.515ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
97802024-12-21T07:55:53.515ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97812024-12-21T07:55:53.515ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
97822024-12-21T07:55:53.515ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
97832024-12-21T07:55:53.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97842024-12-21T07:55:53.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
97852024-12-21T07:55:53.521ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97862024-12-21T07:55:53.522ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97872024-12-21T07:55:53.522ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
97882024-12-21T07:55:53.522ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97892024-12-21T07:55:53.522ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97902024-12-21T07:55:53.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97912024-12-21T07:55:53.524ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97922024-12-21T07:55:53.525ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1473, tv_nsec: 473188559 } })
97932024-12-21T07:55:53.525ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
97942024-12-21T07:55:53.525ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97952024-12-21T07:55:53.525ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
97962024-12-21T07:55:53.525ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97972024-12-21T07:55:53.525ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97982024-12-21T07:55:53.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97992024-12-21T07:55:53.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98002024-12-21T07:55:53.527ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
98012024-12-21T07:55:53.527ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98022024-12-21T07:55:53.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98032024-12-21T07:55:53.531ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98042024-12-21T07:55:53.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98052024-12-21T07:55:53.533ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
98062024-12-21T07:55:53.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
98072024-12-21T07:55:53.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98082024-12-21T07:55:53.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98092024-12-21T07:55:53.534ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1473, tv_nsec: 482676762 } })
98102024-12-21T07:55:53.534ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
98112024-12-21T07:55:53.535ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1473, tv_nsec: 483670679 } })
98122024-12-21T07:55:53.535ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
98132024-12-21T07:55:53.553ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
98142024-12-21T07:55:53.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
98152024-12-21T07:55:53.556ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98162024-12-21T07:55:53.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98172024-12-21T07:55:53.558ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98182024-12-21T07:55:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98192024-12-21T07:55:53.559ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 49.964887ms iteration = 18 status = {"errors":[],"finish_invoked_ok":[]}
98202024-12-21T07:55:53.563ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
98212024-12-21T07:55:53.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
98222024-12-21T07:55:53.564ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98232024-12-21T07:55:53.564ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
98242024-12-21T07:55:53.564ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
98252024-12-21T07:55:53.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
98262024-12-21T07:55:53.565ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 56.034061ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
98272024-12-21T07:55:53.567ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98282024-12-21T07:55:53.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
98292024-12-21T07:55:53.570ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
98302024-12-21T07:55:53.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
98312024-12-21T07:55:53.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
98322024-12-21T07:55:53.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
98332024-12-21T07:55:53.580ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
98342024-12-21T07:55:53.580ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 70.799005ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
98352024-12-21T07:55:53.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
98362024-12-21T07:55:53.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98372024-12-21T07:55:53.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
98382024-12-21T07:55:53.581ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98392024-12-21T07:55:53.583ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 73.848557ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
98402024-12-21T07:55:53.585ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
98412024-12-21T07:55:53.585ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98422024-12-21T07:55:53.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
98432024-12-21T07:55:53.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98442024-12-21T07:55:53.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98452024-12-21T07:55:53.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98462024-12-21T07:55:53.604ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
98472024-12-21T07:55:53.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
98482024-12-21T07:55:53.616ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
98492024-12-21T07:55:53.616ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98502024-12-21T07:55:53.616ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5bbebd9e-6ef4-4a64-bb91-bc3febbc1361", "content-length": "26", "date": "Sat, 21 Dec 2024 07:55:53 GMT"} })
98512024-12-21T07:55:53.616ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98522024-12-21T07:55:53.616ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
98532024-12-21T07:55:53.616ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 107.198658ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
98542024-12-21T07:55:53.619ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
98552024-12-21T07:55:53.619ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98562024-12-21T07:55:53.625ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
98572024-12-21T07:55:53.625ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98582024-12-21T07:55:53.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98592024-12-21T07:55:53.628ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98602024-12-21T07:55:53.628ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
98612024-12-21T07:55:53.628ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 118.926029ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
98622024-12-21T07:55:53.629ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 119.607551ms iteration = 18 status = 0
98632024-12-21T07:55:53.639ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 129.791706ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
98642024-12-21T07:55:53.641ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 132.196867ms iteration = 20 status = {"physical_disks_added":0}
98652024-12-21T07:55:53.645ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 135.482224ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
98662024-12-21T07:55:53.656ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 146.688565ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
98672024-12-21T07:55:53.668ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98682024-12-21T07:55:53.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98692024-12-21T07:55:53.698ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
98702024-12-21T07:55:53.698ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98712024-12-21T07:55:53.698ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e90ae437-1299-4cb6-a135-a914fd3cc146", "content-length": "26", "date": "Sat, 21 Dec 2024 07:55:53 GMT"} })
98722024-12-21T07:55:53.698ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98732024-12-21T07:55:53.700ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
98742024-12-21T07:55:53.714ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
98752024-12-21T07:55:53.714ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98762024-12-21T07:55:53.714ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "818c92f1-1461-4496-9aa1-bc9e2957e5d0", "content-length": "26", "date": "Sat, 21 Dec 2024 07:55:53 GMT"} })
98772024-12-21T07:55:53.714ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98782024-12-21T07:55:53.717ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
98792024-12-21T07:55:53.720ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98802024-12-21T07:55:53.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98812024-12-21T07:55:53.725ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98822024-12-21T07:55:53.729ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
98832024-12-21T07:55:53.729ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98842024-12-21T07:55:53.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98852024-12-21T07:55:53.733ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98862024-12-21T07:55:53.735ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
98872024-12-21T07:55:53.735ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98882024-12-21T07:55:53.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98892024-12-21T07:55:53.740ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
98902024-12-21T07:55:53.741ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "83d7d5e9-7f65-48b5-beca-5c887a38a12a", "content-length": "1", "date": "Sat, 21 Dec 2024 07:55:53 GMT"} })
98912024-12-21T07:55:53.743ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
98922024-12-21T07:55:53.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
98932024-12-21T07:55:53.748ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 238.675024ms iteration = 18 status = null
98942024-12-21T07:55:53.827ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
98952024-12-21T07:55:53.827ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
98962024-12-21T07:55:53.827ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "47b39c04-2292-4140-afcc-24949e2edc34", "content-length": "372", "date": "Sat, 21 Dec 2024 07:55:53 GMT"} })
98972024-12-21T07:55:53.827ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98982024-12-21T07:55:53.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98992024-12-21T07:55:53.828ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 319.004741ms iteration = 18 status = {}
99002024-12-21T07:55:53.831ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
99012024-12-21T07:55:53.831ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "071d76e4-d92a-48aa-833e-1dc8b3b90c30", "content-length": "691", "date": "Sat, 21 Dec 2024 07:55:53 GMT"} })
99022024-12-21T07:55:53.831ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
99032024-12-21T07:55:53.831ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
99042024-12-21T07:55:53.831ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
99052024-12-21T07:55:53.833ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 323.602141ms iteration = 18 status = {}
99062024-12-21T07:55:53.869ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
99072024-12-21T07:55:53.869ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
99082024-12-21T07:55:53.889ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99092024-12-21T07:55:53.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99102024-12-21T07:55:53.892ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
99112024-12-21T07:55:53.892ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99122024-12-21T07:55:53.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99132024-12-21T07:55:53.909ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
99142024-12-21T07:55:53.909ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4c627bc-5b49-4868-b075-9974d2c2f445", "content-length": "134", "date": "Sat, 21 Dec 2024 07:55:53 GMT"} })
99152024-12-21T07:55:53.909ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
99162024-12-21T07:55:53.909ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
99172024-12-21T07:55:53.910ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
99182024-12-21T07:55:53.910ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
99192024-12-21T07:55:53.910ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99202024-12-21T07:55:53.910ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99212024-12-21T07:55:53.910ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99222024-12-21T07:55:53.910ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99232024-12-21T07:55:53.910ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99242024-12-21T07:55:53.910ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99252024-12-21T07:55:53.910ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
99262024-12-21T07:55:53.910ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99272024-12-21T07:55:53.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99282024-12-21T07:55:53.913ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
99292024-12-21T07:55:53.913ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e91a37d-a5a5-4d51-824d-6f02253480c3", "content-length": "2", "date": "Sat, 21 Dec 2024 07:55:53 GMT"} })
99302024-12-21T07:55:53.913ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
99312024-12-21T07:55:53.913ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c321bd26-efe2-4f23-bc03-a351daf0ee17", "content-length": "52", "date": "Sat, 21 Dec 2024 07:55:53 GMT"} })
99322024-12-21T07:55:53.913ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
99332024-12-21T07:55:53.913ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
99342024-12-21T07:55:53.960ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "74f9dcbf-85ba-4dd2-8d1c-3375859e1f04", "date": "Sat, 21 Dec 2024 07:55:53 GMT"} })
99352024-12-21T07:55:53.960ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99362024-12-21T07:55:53.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99372024-12-21T07:55:53.963ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99382024-12-21T07:55:53.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99392024-12-21T07:55:53.966ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99402024-12-21T07:55:53.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99412024-12-21T07:55:53.969ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
99422024-12-21T07:55:53.970ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99432024-12-21T07:55:53.970ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a0692c14-f0ce-461a-91e3-49ff456cad56", "date": "Sat, 21 Dec 2024 07:55:53 GMT"} })
99442024-12-21T07:55:53.971ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 462.302629ms iteration = 19 status = {}
99452024-12-21T07:55:54.151ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "05eae05f-68dc-496f-bc53-ac153a1be5b6", "date": "Sat, 21 Dec 2024 07:55:53 GMT"} })
99462024-12-21T07:55:54.151ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
99472024-12-21T07:55:54.151ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
99482024-12-21T07:55:54.151ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb66fadc-9977-4071-8396-853c1002de00", "content-length": "682", "date": "Sat, 21 Dec 2024 07:55:53 GMT"} })
99492024-12-21T07:55:54.151ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99502024-12-21T07:55:54.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99512024-12-21T07:55:54.155ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99522024-12-21T07:55:54.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99532024-12-21T07:55:54.158ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99542024-12-21T07:55:54.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99552024-12-21T07:55:54.161ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99562024-12-21T07:55:54.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99572024-12-21T07:55:54.168ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 659.342459ms iteration = 18 status = {}
99582024-12-21T07:55:54.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 4c556cd2-d966-4935-b617-fb43394ed23c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
99592024-12-21T07:55:54.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 4c556cd2-d966-4935-b617-fb43394ed23c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
99602024-12-21T07:55:54.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3823 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 4c556cd2-d966-4935-b617-fb43394ed23c response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
99612024-12-21T07:55:55.900ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1308 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = c04939f0-20a2-4590-8cac-d75de71d3e0e response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
99622024-12-21T07:56:03.510ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
99632024-12-21T07:56:03.510ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
99642024-12-21T07:56:03.510ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99652024-12-21T07:56:03.510ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99662024-12-21T07:56:03.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99672024-12-21T07:56:03.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99682024-12-21T07:56:03.512ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99692024-12-21T07:56:03.515ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
99702024-12-21T07:56:03.515ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99712024-12-21T07:56:03.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99722024-12-21T07:56:03.516ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99732024-12-21T07:56:03.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99742024-12-21T07:56:03.518ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99752024-12-21T07:56:03.520ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
99762024-12-21T07:56:03.520ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99772024-12-21T07:56:03.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99782024-12-21T07:56:03.531ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
99792024-12-21T07:56:03.531ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.819424ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
99802024-12-21T07:56:03.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99812024-12-21T07:56:03.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99822024-12-21T07:56:03.541ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.52671ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
99832024-12-21T07:56:05.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 77e26514-ed3b-4c1b-93f1-cd54773b417d roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
99842024-12-21T07:56:05.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 77e26514-ed3b-4c1b-93f1-cd54773b417d resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
99852024-12-21T07:56:05.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2705 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 77e26514-ed3b-4c1b-93f1-cd54773b417d response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
99862024-12-21T07:56:05.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = c8ab129d-9b5c-4c3c-ae5d-282c3dd5a389 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
99872024-12-21T07:56:05.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = c8ab129d-9b5c-4c3c-ae5d-282c3dd5a389 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
99882024-12-21T07:56:05.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2384 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = c8ab129d-9b5c-4c3c-ae5d-282c3dd5a389 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
99892024-12-21T07:56:05.900ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1238 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 04834d21-31ad-4dc9-a5a7-7a66b4769a01 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
99902024-12-21T07:56:13.510ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
99912024-12-21T07:56:13.510ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
99922024-12-21T07:56:13.510ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99932024-12-21T07:56:13.510ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99942024-12-21T07:56:13.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99952024-12-21T07:56:13.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99962024-12-21T07:56:13.512ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99972024-12-21T07:56:13.512ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99982024-12-21T07:56:13.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99992024-12-21T07:56:13.514ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.187231ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
100002024-12-21T07:56:13.515ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100012024-12-21T07:56:13.515ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100022024-12-21T07:56:13.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100032024-12-21T07:56:13.516ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100042024-12-21T07:56:13.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100052024-12-21T07:56:13.518ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100062024-12-21T07:56:13.520ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
100072024-12-21T07:56:13.520ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100082024-12-21T07:56:13.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100092024-12-21T07:56:13.532ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
100102024-12-21T07:56:13.532ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.12417ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
100112024-12-21T07:56:15.900ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1144 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 74ccf21f-97af-4137-afcd-14354179099d response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
100122024-12-21T07:56:23.509ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
100132024-12-21T07:56:23.509ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
100142024-12-21T07:56:23.509ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
100152024-12-21T07:56:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
100162024-12-21T07:56:23.509ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
100172024-12-21T07:56:23.509ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100182024-12-21T07:56:23.509ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
100192024-12-21T07:56:23.509ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
100202024-12-21T07:56:23.509ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
100212024-12-21T07:56:23.509ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
100222024-12-21T07:56:23.509ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
100232024-12-21T07:56:23.509ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
100242024-12-21T07:56:23.509ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
100252024-12-21T07:56:23.509ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:46:23.509977623 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
100262024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
100272024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
100282024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
100292024-12-21T07:56:23.510ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
100302024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
100312024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
100322024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100332024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
100342024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
100352024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
100362024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
100372024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
100382024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
100392024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
100402024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
100412024-12-21T07:56:23.510ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 3f45718f-9869-448a-a087-788e66db5e9d
100422024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.59\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"3f45718f-9869-448a-a087-788e66db5e9d"}
100432024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
100442024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
100452024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100462024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
100472024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
100482024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
100492024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100502024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
100512024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100522024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
100532024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
100542024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
100552024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
100562024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
100572024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
100582024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
100592024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
100602024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
100612024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
100622024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100632024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
100642024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
100652024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
100662024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
100672024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
100682024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
100692024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
100702024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
100712024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
100722024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
100732024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
100742024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
100752024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
100762024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
100772024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
100782024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
100792024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
100802024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
100812024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
100822024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100832024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
100842024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
100852024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
100862024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
100872024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
100882024-12-21T07:56:23.510ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
100892024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
100902024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
100912024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
100922024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
100932024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100942024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
100952024-12-21T07:56:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
100962024-12-21T07:56:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
100972024-12-21T07:56:23.511ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
100982024-12-21T07:56:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
100992024-12-21T07:56:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101002024-12-21T07:56:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
101012024-12-21T07:56:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
101022024-12-21T07:56:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
101032024-12-21T07:56:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101042024-12-21T07:56:23.511ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101052024-12-21T07:56:23.511ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1595c632-cfae-4f6b-937d-d413dd8cf0b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1503, tv_nsec: 459087088 } })
101062024-12-21T07:56:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101072024-12-21T07:56:23.511ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101082024-12-21T07:56:23.511ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("481de7e8-0737-474b-8c33-e6e8bc6477be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("683a9892-43cd-4dd8-a983-26cccd988df0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1503, tv_nsec: 459358342 } })
101092024-12-21T07:56:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101102024-12-21T07:56:23.511ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101112024-12-21T07:56:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101122024-12-21T07:56:23.512ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
101132024-12-21T07:56:23.512ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.068536ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
101142024-12-21T07:56:23.512ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
101152024-12-21T07:56:23.512ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 2.112896ms iteration = 11 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
101162024-12-21T07:56:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101172024-12-21T07:56:23.518ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101182024-12-21T07:56:23.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101192024-12-21T07:56:23.519ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1503, tv_nsec: 466958712 } })
101202024-12-21T07:56:23.519ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:46:23.509977623 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
101212024-12-21T07:56:23.519ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.358921ms iteration = 10 status = {"expiration":"2024-12-21T07:46:23.509977623Z","pruned":[]}
101222024-12-21T07:56:23.519ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
101232024-12-21T07:56:23.519ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101242024-12-21T07:56:23.520ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101252024-12-21T07:56:23.520ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
101262024-12-21T07:56:23.521ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101272024-12-21T07:56:23.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
101282024-12-21T07:56:23.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
101292024-12-21T07:56:23.521ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101302024-12-21T07:56:23.522ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
101312024-12-21T07:56:23.522ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
101322024-12-21T07:56:23.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
101332024-12-21T07:56:23.523ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
101342024-12-21T07:56:23.523ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101352024-12-21T07:56:23.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101362024-12-21T07:56:23.524ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
101372024-12-21T07:56:23.524ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101382024-12-21T07:56:23.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101392024-12-21T07:56:23.525ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101402024-12-21T07:56:23.526ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101412024-12-21T07:56:23.528ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
101422024-12-21T07:56:23.528ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
101432024-12-21T07:56:23.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
101442024-12-21T07:56:23.529ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 18.65067ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
101452024-12-21T07:56:23.530ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
101462024-12-21T07:56:23.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101472024-12-21T07:56:23.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101482024-12-21T07:56:23.532ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
101492024-12-21T07:56:23.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
101502024-12-21T07:56:23.534ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101512024-12-21T07:56:23.535ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 24.918447ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
101522024-12-21T07:56:23.536ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 25.898175ms iteration = 19 status = {"errors":[],"finish_invoked_ok":[]}
101532024-12-21T07:56:23.536ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101542024-12-21T07:56:23.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
101552024-12-21T07:56:23.537ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101562024-12-21T07:56:23.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101572024-12-21T07:56:23.539ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1503, tv_nsec: 486877734 } })
101582024-12-21T07:56:23.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
101592024-12-21T07:56:23.539ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101602024-12-21T07:56:23.539ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
101612024-12-21T07:56:23.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101622024-12-21T07:56:23.547ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101632024-12-21T07:56:23.547ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101642024-12-21T07:56:23.548ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
101652024-12-21T07:56:23.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
101662024-12-21T07:56:23.549ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101672024-12-21T07:56:23.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
101682024-12-21T07:56:23.552ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
101692024-12-21T07:56:23.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
101702024-12-21T07:56:23.552ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101712024-12-21T07:56:23.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
101722024-12-21T07:56:23.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101732024-12-21T07:56:23.552ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101742024-12-21T07:56:23.555ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
101752024-12-21T07:56:23.556ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
101762024-12-21T07:56:23.556ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101772024-12-21T07:56:23.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101782024-12-21T07:56:23.557ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101792024-12-21T07:56:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
101802024-12-21T07:56:23.560ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101812024-12-21T07:56:23.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101822024-12-21T07:56:23.565ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101832024-12-21T07:56:23.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
101842024-12-21T07:56:23.567ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101852024-12-21T07:56:23.568ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101862024-12-21T07:56:23.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101872024-12-21T07:56:23.569ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
101882024-12-21T07:56:23.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101892024-12-21T07:56:23.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
101902024-12-21T07:56:23.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101912024-12-21T07:56:23.571ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
101922024-12-21T07:56:23.571ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101932024-12-21T07:56:23.571ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1503, tv_nsec: 519000205 } })
101942024-12-21T07:56:23.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101952024-12-21T07:56:23.571ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
101962024-12-21T07:56:23.573ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
101972024-12-21T07:56:23.573ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 63.344936ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
101982024-12-21T07:56:23.576ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101992024-12-21T07:56:23.576ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102002024-12-21T07:56:23.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102012024-12-21T07:56:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
102022024-12-21T07:56:23.580ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102032024-12-21T07:56:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102042024-12-21T07:56:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
102052024-12-21T07:56:23.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102062024-12-21T07:56:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102072024-12-21T07:56:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
102082024-12-21T07:56:23.581ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
102092024-12-21T07:56:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
102102024-12-21T07:56:23.587ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 77.670842ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
102112024-12-21T07:56:23.590ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
102122024-12-21T07:56:23.590ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
102132024-12-21T07:56:23.590ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 80.049643ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
102142024-12-21T07:56:23.592ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102152024-12-21T07:56:23.592ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
102162024-12-21T07:56:23.592ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102172024-12-21T07:56:23.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102182024-12-21T07:56:23.594ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102192024-12-21T07:56:23.596ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102202024-12-21T07:56:23.596ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
102212024-12-21T07:56:23.596ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102222024-12-21T07:56:23.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102232024-12-21T07:56:23.597ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
102242024-12-21T07:56:23.597ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
102252024-12-21T07:56:23.597ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102262024-12-21T07:56:23.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
102272024-12-21T07:56:23.601ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
102282024-12-21T07:56:23.601ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102292024-12-21T07:56:23.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102302024-12-21T07:56:23.604ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 94.016512ms iteration = 5 status = {"nsuccess":5}
102312024-12-21T07:56:23.606ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102322024-12-21T07:56:23.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102332024-12-21T07:56:23.606ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102342024-12-21T07:56:23.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
102352024-12-21T07:56:23.611ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 101.892038ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
102362024-12-21T07:56:23.612ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
102372024-12-21T07:56:23.612ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 102.792674ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
102382024-12-21T07:56:23.620ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
102392024-12-21T07:56:23.620ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
102402024-12-21T07:56:23.620ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
102412024-12-21T07:56:23.620ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
102422024-12-21T07:56:23.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102432024-12-21T07:56:23.621ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 111.31994ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
102442024-12-21T07:56:23.622ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102452024-12-21T07:56:23.623ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 113.342454ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
102462024-12-21T07:56:23.625ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 114.921091ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
102472024-12-21T07:56:23.627ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
102482024-12-21T07:56:23.627ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
102492024-12-21T07:56:23.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102502024-12-21T07:56:23.640ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
102512024-12-21T07:56:23.640ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
102522024-12-21T07:56:23.640ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 129.558972ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
102532024-12-21T07:56:23.657ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
102542024-12-21T07:56:23.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
102552024-12-21T07:56:23.658ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102562024-12-21T07:56:23.658ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
102572024-12-21T07:56:23.658ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 147.638772ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
102582024-12-21T07:56:23.659ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
102592024-12-21T07:56:23.660ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102602024-12-21T07:56:23.663ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
102612024-12-21T07:56:23.663ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
102622024-12-21T07:56:23.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
102632024-12-21T07:56:23.674ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
102642024-12-21T07:56:23.677ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102652024-12-21T07:56:23.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102662024-12-21T07:56:23.678ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
102672024-12-21T07:56:23.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
102682024-12-21T07:56:23.680ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102692024-12-21T07:56:23.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102702024-12-21T07:56:23.682ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
102712024-12-21T07:56:23.683ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
102722024-12-21T07:56:23.683ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
102732024-12-21T07:56:23.683ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
102742024-12-21T07:56:23.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102752024-12-21T07:56:23.684ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
102762024-12-21T07:56:23.684ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 0 version = 2
102772024-12-21T07:56:23.684ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
102782024-12-21T07:56:23.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102792024-12-21T07:56:23.685ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102802024-12-21T07:56:23.689ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
102812024-12-21T07:56:23.689ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
102822024-12-21T07:56:23.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102832024-12-21T07:56:23.734ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:47:21.583817Z, time_modified: 2024-12-21T07:47:21.583817Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }) }
102842024-12-21T07:56:23.734ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 224.765956ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]}},"default_endpoint":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
102852024-12-21T07:56:23.735ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
102862024-12-21T07:56:23.735ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102872024-12-21T07:56:23.735ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "15dc6a80-3de5-4b82-b8da-cc4ec7359459", "content-length": "26", "date": "Sat, 21 Dec 2024 07:56:23 GMT"} })
102882024-12-21T07:56:23.735ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102892024-12-21T07:56:23.737ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
102902024-12-21T07:56:23.739ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
102912024-12-21T07:56:23.739ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102922024-12-21T07:56:23.739ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca97ef49-01f8-408c-a3f1-ff4e2e8864d3", "content-length": "26", "date": "Sat, 21 Dec 2024 07:56:23 GMT"} })
102932024-12-21T07:56:23.739ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102942024-12-21T07:56:23.741ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
102952024-12-21T07:56:23.742ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102962024-12-21T07:56:23.746ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
102972024-12-21T07:56:23.746ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
102982024-12-21T07:56:23.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102992024-12-21T07:56:23.751ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 1 version = 2
103002024-12-21T07:56:23.751ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
103012024-12-21T07:56:23.751ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 07:47:25.290148 UTC dns_group = external generation = 2
103022024-12-21T07:56:23.751ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 241.778467ms iteration = 11 status = {"generation":2}
103032024-12-21T07:56:23.752ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103042024-12-21T07:56:23.754ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
103052024-12-21T07:56:23.754ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
103062024-12-21T07:56:23.754ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
103072024-12-21T07:56:23.755ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
103082024-12-21T07:56:23.755ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103092024-12-21T07:56:23.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
103102024-12-21T07:56:23.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103112024-12-21T07:56:23.757ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103122024-12-21T07:56:23.758ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 247.994984ms iteration = 19 status = 0
103132024-12-21T07:56:23.761ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103142024-12-21T07:56:23.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103152024-12-21T07:56:23.762ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
103162024-12-21T07:56:23.762ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
103172024-12-21T07:56:23.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
103182024-12-21T07:56:23.765ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
103192024-12-21T07:56:23.765ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
103202024-12-21T07:56:23.766ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 07:47:23.936594 UTC dns_group = internal generation = 1
103212024-12-21T07:56:23.766ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 256.846356ms iteration = 11 status = {"generation":1}
103222024-12-21T07:56:23.774ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 264.190031ms iteration = 21 status = {"physical_disks_added":0}
103232024-12-21T07:56:23.814ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
103242024-12-21T07:56:23.814ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
103252024-12-21T07:56:23.814ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca0a201d-879d-413a-9e46-f083d043513e", "content-length": "26", "date": "Sat, 21 Dec 2024 07:56:23 GMT"} })
103262024-12-21T07:56:23.814ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
103272024-12-21T07:56:23.817ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
103282024-12-21T07:56:23.846ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
103292024-12-21T07:56:23.846ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 335.265941ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
103302024-12-21T07:56:23.869ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
103312024-12-21T07:56:23.870ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "e6e92e7d-be12-4c5f-a13d-186918881167", "date": "Sat, 21 Dec 2024 07:56:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
103322024-12-21T07:56:23.870ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
103332024-12-21T07:56:23.871ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "54b35d36-c475-4dac-be74-6a499233e428", "date": "Sat, 21 Dec 2024 07:56:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
103342024-12-21T07:56:23.871ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
103352024-12-21T07:56:23.873ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
103362024-12-21T07:56:23.873ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 363.443723ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
103372024-12-21T07:56:23.885ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103382024-12-21T07:56:23.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103392024-12-21T07:56:23.889ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103402024-12-21T07:56:23.890ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
103412024-12-21T07:56:23.890ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103422024-12-21T07:56:23.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103432024-12-21T07:56:23.892ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103442024-12-21T07:56:23.894ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
103452024-12-21T07:56:23.894ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103462024-12-21T07:56:23.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103472024-12-21T07:56:23.904ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
103482024-12-21T07:56:23.904ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
103492024-12-21T07:56:23.905ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e45ece06-c88e-4046-86ce-3395ff9f6dcc", "content-length": "372", "date": "Sat, 21 Dec 2024 07:56:23 GMT"} })
103502024-12-21T07:56:23.905ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103512024-12-21T07:56:23.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103522024-12-21T07:56:23.922ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
103532024-12-21T07:56:23.922ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
103542024-12-21T07:56:23.922ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ec42b93a-7d38-496b-945b-04700a95df64", "date": "Sat, 21 Dec 2024 07:56:23 GMT"} })
103552024-12-21T07:56:23.922ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103562024-12-21T07:56:23.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103572024-12-21T07:56:23.925ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103582024-12-21T07:56:23.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103592024-12-21T07:56:23.928ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103602024-12-21T07:56:23.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103612024-12-21T07:56:23.932ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 422.954704ms iteration = 19 status = {}
103622024-12-21T07:56:23.940ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
103632024-12-21T07:56:23.975ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
103642024-12-21T07:56:23.975ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6cdf3628-5004-4d49-ab50-645e0eea085f", "content-length": "1", "date": "Sat, 21 Dec 2024 07:56:23 GMT"} })
103652024-12-21T07:56:23.977ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
103662024-12-21T07:56:23.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
103672024-12-21T07:56:24.009ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
103682024-12-21T07:56:24.012ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 501.941289ms iteration = 19 status = null
103692024-12-21T07:56:24.013ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
103702024-12-21T07:56:24.013ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
103712024-12-21T07:56:24.103ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
103722024-12-21T07:56:24.104ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "d9b2acda-32ef-4579-a875-424ac9aaa713", "date": "Sat, 21 Dec 2024 07:56:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
103732024-12-21T07:56:24.104ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
103742024-12-21T07:56:24.105ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "e7c338b2-b254-4de7-b967-336ef387ae2f", "date": "Sat, 21 Dec 2024 07:56:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
103752024-12-21T07:56:24.105ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
103762024-12-21T07:56:24.107ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "07e5d668-90c5-48b4-80fb-41727f828a90", "date": "Sat, 21 Dec 2024 07:56:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
103772024-12-21T07:56:24.107ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
103782024-12-21T07:56:24.109ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
103792024-12-21T07:56:24.109ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 599.433451ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
103802024-12-21T07:56:24.110ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd4721af-e5c6-4377-9c5f-01ea89f30f3c", "content-length": "691", "date": "Sat, 21 Dec 2024 07:56:23 GMT"} })
103812024-12-21T07:56:24.110ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
103822024-12-21T07:56:24.110ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
103832024-12-21T07:56:24.110ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
103842024-12-21T07:56:24.110ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "37d8aa06-548e-4412-ad69-4c5022e0b883", "date": "Sat, 21 Dec 2024 07:56:23 GMT"} })
103852024-12-21T07:56:24.112ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 602.087216ms iteration = 19 status = {}
103862024-12-21T07:56:24.112ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 602.26928ms iteration = 20 status = {}
103872024-12-21T07:56:24.139ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103882024-12-21T07:56:24.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103892024-12-21T07:56:24.141ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
103902024-12-21T07:56:24.141ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103912024-12-21T07:56:24.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103922024-12-21T07:56:24.150ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
103932024-12-21T07:56:24.151ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "caa08277-f499-4065-bce1-08a402232c42", "content-length": "134", "date": "Sat, 21 Dec 2024 07:56:23 GMT"} })
103942024-12-21T07:56:24.151ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
103952024-12-21T07:56:24.151ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
103962024-12-21T07:56:24.151ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
103972024-12-21T07:56:24.151ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
103982024-12-21T07:56:24.151ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103992024-12-21T07:56:24.151ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
104002024-12-21T07:56:24.151ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
104012024-12-21T07:56:24.151ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
104022024-12-21T07:56:24.151ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
104032024-12-21T07:56:24.151ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
104042024-12-21T07:56:24.151ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
104052024-12-21T07:56:24.151ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104062024-12-21T07:56:24.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104072024-12-21T07:56:24.153ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
104082024-12-21T07:56:24.153ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "99ef7d23-a465-4ed6-b2d1-a7f877587d14", "content-length": "2", "date": "Sat, 21 Dec 2024 07:56:23 GMT"} })
104092024-12-21T07:56:24.153ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
104102024-12-21T07:56:24.153ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6998f6f-0c58-413e-befc-2b8dbe2e75a0", "content-length": "52", "date": "Sat, 21 Dec 2024 07:56:23 GMT"} })
104112024-12-21T07:56:24.153ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
104122024-12-21T07:56:24.153ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
104132024-12-21T07:56:24.248ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f8baa873-4d77-41fa-9d23-04aaa439e46f", "date": "Sat, 21 Dec 2024 07:56:23 GMT"} })
104142024-12-21T07:56:24.248ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
104152024-12-21T07:56:24.248ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
104162024-12-21T07:56:24.248ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ce9a134-014d-4002-99f8-2824290557f9", "content-length": "682", "date": "Sat, 21 Dec 2024 07:56:24 GMT"} })
104172024-12-21T07:56:24.248ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104182024-12-21T07:56:24.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104192024-12-21T07:56:24.252ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104202024-12-21T07:56:24.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104212024-12-21T07:56:24.257ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104222024-12-21T07:56:24.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104232024-12-21T07:56:24.259ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104242024-12-21T07:56:24.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104252024-12-21T07:56:24.266ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 756.76382ms iteration = 19 status = {}
104262024-12-21T07:56:24.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 4de8cd77-3155-4c22-8697-63ce4a6e1ac8 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
104272024-12-21T07:56:24.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 4de8cd77-3155-4c22-8697-63ce4a6e1ac8 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
104282024-12-21T07:56:24.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3285 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 4de8cd77-3155-4c22-8697-63ce4a6e1ac8 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
104292024-12-21T07:56:25.900ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1271 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = eb44dd37-aa83-4382-8aee-176050ee896c response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
104302024-12-21T07:56:33.510ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
104312024-12-21T07:56:33.510ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104322024-12-21T07:56:33.510ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
104332024-12-21T07:56:33.510ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104342024-12-21T07:56:33.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104352024-12-21T07:56:33.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104362024-12-21T07:56:33.512ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104372024-12-21T07:56:33.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104382024-12-21T07:56:33.513ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104392024-12-21T07:56:33.513ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.50477ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
104402024-12-21T07:56:33.515ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
104412024-12-21T07:56:33.515ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104422024-12-21T07:56:33.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104432024-12-21T07:56:33.518ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104442024-12-21T07:56:33.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104452024-12-21T07:56:33.519ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104462024-12-21T07:56:33.522ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
104472024-12-21T07:56:33.522ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104482024-12-21T07:56:33.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104492024-12-21T07:56:33.532ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
104502024-12-21T07:56:33.532ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.463096ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
104512024-12-21T07:56:35.901ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1327 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 0c823fc3-aa9d-4da6-9153-69893bacbe69 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
104522024-12-21T07:56:43.510ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
104532024-12-21T07:56:43.510ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
104542024-12-21T07:56:43.510ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104552024-12-21T07:56:43.510ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104562024-12-21T07:56:43.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104572024-12-21T07:56:43.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104582024-12-21T07:56:43.512ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104592024-12-21T07:56:43.512ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104602024-12-21T07:56:43.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104612024-12-21T07:56:43.514ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.449376ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
104622024-12-21T07:56:43.514ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
104632024-12-21T07:56:43.514ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104642024-12-21T07:56:43.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104652024-12-21T07:56:43.516ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104662024-12-21T07:56:43.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104672024-12-21T07:56:43.517ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104682024-12-21T07:56:43.520ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
104692024-12-21T07:56:43.520ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104702024-12-21T07:56:43.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104712024-12-21T07:56:43.528ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
104722024-12-21T07:56:43.528ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.225442ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
104732024-12-21T07:56:45.900ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1116 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = f0836ad6-5cdd-45df-9aee-ef1c3db338a4 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
104742024-12-21T07:56:53.510ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
104752024-12-21T07:56:53.510ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
104762024-12-21T07:56:53.510ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
104772024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
104782024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104792024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
104802024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
104812024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
104822024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
104832024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
104842024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
104852024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
104862024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
104872024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
104882024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
104892024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104902024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
104912024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
104922024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
104932024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104942024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
104952024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
104962024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
104972024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
104982024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
104992024-12-21T07:56:53.511ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
105002024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105012024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
105022024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
105032024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
105042024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
105052024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
105062024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105072024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
105082024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
105092024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
105102024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105112024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
105122024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
105132024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
105142024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
105152024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
105162024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105172024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
105182024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105192024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105202024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
105212024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105222024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105232024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
105242024-12-21T07:56:53.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
105252024-12-21T07:56:53.513ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105262024-12-21T07:56:53.515ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.928087ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
105272024-12-21T07:56:53.516ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1533, tv_nsec: 463963011 } })
105282024-12-21T07:56:53.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
105292024-12-21T07:56:53.516ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105302024-12-21T07:56:53.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105312024-12-21T07:56:53.516ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
105322024-12-21T07:56:53.518ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105332024-12-21T07:56:53.519ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105342024-12-21T07:56:53.520ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
105352024-12-21T07:56:53.520ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105362024-12-21T07:56:53.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
105372024-12-21T07:56:53.522ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
105382024-12-21T07:56:53.522ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
105392024-12-21T07:56:53.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
105402024-12-21T07:56:53.523ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
105412024-12-21T07:56:53.524ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105422024-12-21T07:56:53.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105432024-12-21T07:56:53.524ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1533, tv_nsec: 472108191 } })
105442024-12-21T07:56:53.524ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
105452024-12-21T07:56:53.524ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105462024-12-21T07:56:53.525ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
105472024-12-21T07:56:53.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105482024-12-21T07:56:53.526ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105492024-12-21T07:56:53.529ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
105502024-12-21T07:56:53.529ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105512024-12-21T07:56:53.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
105522024-12-21T07:56:53.530ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105532024-12-21T07:56:53.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105542024-12-21T07:56:53.537ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105552024-12-21T07:56:53.537ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
105562024-12-21T07:56:53.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
105572024-12-21T07:56:53.539ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105582024-12-21T07:56:53.539ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1533, tv_nsec: 486545478 } })
105592024-12-21T07:56:53.539ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
105602024-12-21T07:56:53.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
105612024-12-21T07:56:53.540ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
105622024-12-21T07:56:53.540ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105632024-12-21T07:56:53.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105642024-12-21T07:56:53.541ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
105652024-12-21T07:56:53.541ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 30.750837ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
105662024-12-21T07:56:53.549ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105672024-12-21T07:56:53.549ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105682024-12-21T07:56:53.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105692024-12-21T07:56:53.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
105702024-12-21T07:56:53.551ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105712024-12-21T07:56:53.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
105722024-12-21T07:56:53.559ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105732024-12-21T07:56:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105742024-12-21T07:56:53.560ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 49.625822ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
105752024-12-21T07:56:53.561ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105762024-12-21T07:56:53.563ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 52.873627ms iteration = 20 status = {"errors":[],"finish_invoked_ok":[]}
105772024-12-21T07:56:53.565ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
105782024-12-21T07:56:53.565ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105792024-12-21T07:56:53.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105802024-12-21T07:56:53.567ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105812024-12-21T07:56:53.569ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
105822024-12-21T07:56:53.569ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105832024-12-21T07:56:53.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105842024-12-21T07:56:53.570ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105852024-12-21T07:56:53.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105862024-12-21T07:56:53.572ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.164258ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
105872024-12-21T07:56:53.572ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
105882024-12-21T07:56:53.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
105892024-12-21T07:56:53.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
105902024-12-21T07:56:53.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
105912024-12-21T07:56:53.576ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 65.718188ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
105922024-12-21T07:56:53.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105932024-12-21T07:56:53.578ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
105942024-12-21T07:56:53.578ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
105952024-12-21T07:56:53.578ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
105962024-12-21T07:56:53.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
105972024-12-21T07:56:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
105982024-12-21T07:56:53.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105992024-12-21T07:56:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106002024-12-21T07:56:53.588ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 77.606701ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
106012024-12-21T07:56:53.591ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 80.080294ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
106022024-12-21T07:56:53.593ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 82.761849ms iteration = 22 status = {"physical_disks_added":0}
106032024-12-21T07:56:53.629ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
106042024-12-21T07:56:53.629ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
106052024-12-21T07:56:53.629ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "108ae8cc-9733-4457-9b71-5c41019aef8e", "content-length": "26", "date": "Sat, 21 Dec 2024 07:56:53 GMT"} })
106062024-12-21T07:56:53.629ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
106072024-12-21T07:56:53.632ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
106082024-12-21T07:56:53.637ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
106092024-12-21T07:56:53.637ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
106102024-12-21T07:56:53.637ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7322a68a-3d7f-4683-8521-95bf9220b228", "content-length": "26", "date": "Sat, 21 Dec 2024 07:56:53 GMT"} })
106112024-12-21T07:56:53.637ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
106122024-12-21T07:56:53.639ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
106132024-12-21T07:56:53.639ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106142024-12-21T07:56:53.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106152024-12-21T07:56:53.660ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
106162024-12-21T07:56:53.660ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
106172024-12-21T07:56:53.660ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "53dfa240-e2fa-45a2-a9c5-467bca1f6812", "content-length": "26", "date": "Sat, 21 Dec 2024 07:56:53 GMT"} })
106182024-12-21T07:56:53.660ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
106192024-12-21T07:56:53.662ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
106202024-12-21T07:56:53.710ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
106212024-12-21T07:56:53.710ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "581618d4-d349-4e6f-8806-0bb5bcde2f7a", "content-length": "691", "date": "Sat, 21 Dec 2024 07:56:53 GMT"} })
106222024-12-21T07:56:53.710ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
106232024-12-21T07:56:53.710ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
106242024-12-21T07:56:53.710ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
106252024-12-21T07:56:53.713ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 202.232939ms iteration = 20 status = {}
106262024-12-21T07:56:53.780ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
106272024-12-21T07:56:53.781ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b599716a-54f3-4bf7-bded-02cc2adf8d9a", "content-length": "1", "date": "Sat, 21 Dec 2024 07:56:53 GMT"} })
106282024-12-21T07:56:53.782ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
106292024-12-21T07:56:53.782ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
106302024-12-21T07:56:53.782ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff6353a8-1cc7-4930-8dfb-087a59231170", "content-length": "372", "date": "Sat, 21 Dec 2024 07:56:53 GMT"} })
106312024-12-21T07:56:53.782ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106322024-12-21T07:56:53.782ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
106332024-12-21T07:56:53.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106342024-12-21T07:56:53.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
106352024-12-21T07:56:53.785ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106362024-12-21T07:56:53.785ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106372024-12-21T07:56:53.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106382024-12-21T07:56:53.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106392024-12-21T07:56:53.786ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 275.72864ms iteration = 20 status = null
106402024-12-21T07:56:53.787ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106412024-12-21T07:56:53.787ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106422024-12-21T07:56:53.790ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
106432024-12-21T07:56:53.790ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106442024-12-21T07:56:53.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106452024-12-21T07:56:53.792ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
106462024-12-21T07:56:53.792ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106472024-12-21T07:56:53.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106482024-12-21T07:56:53.797ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 286.426923ms iteration = 20 status = 0
106492024-12-21T07:56:53.808ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
106502024-12-21T07:56:53.808ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 297.32663ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
106512024-12-21T07:56:53.815ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
106522024-12-21T07:56:53.815ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
106532024-12-21T07:56:53.815ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
106542024-12-21T07:56:53.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
106552024-12-21T07:56:53.833ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 322.662284ms iteration = 20 status = {}
106562024-12-21T07:56:53.836ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
106572024-12-21T07:56:53.836ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
106582024-12-21T07:56:53.862ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
106592024-12-21T07:56:53.862ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
106602024-12-21T07:56:53.862ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 351.0192ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
106612024-12-21T07:56:53.901ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106622024-12-21T07:56:53.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106632024-12-21T07:56:53.903ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
106642024-12-21T07:56:53.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106652024-12-21T07:56:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106662024-12-21T07:56:53.915ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
106672024-12-21T07:56:53.915ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9064094d-66c3-45f4-87d2-8f0ce72ff2ee", "content-length": "134", "date": "Sat, 21 Dec 2024 07:56:53 GMT"} })
106682024-12-21T07:56:53.915ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
106692024-12-21T07:56:53.916ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
106702024-12-21T07:56:53.916ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
106712024-12-21T07:56:53.916ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
106722024-12-21T07:56:53.916ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
106732024-12-21T07:56:53.916ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
106742024-12-21T07:56:53.916ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
106752024-12-21T07:56:53.916ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
106762024-12-21T07:56:53.916ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
106772024-12-21T07:56:53.916ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
106782024-12-21T07:56:53.916ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
106792024-12-21T07:56:53.916ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106802024-12-21T07:56:53.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106812024-12-21T07:56:53.919ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
106822024-12-21T07:56:53.919ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e94d55d-0510-4d59-910d-3ebf55160946", "content-length": "2", "date": "Sat, 21 Dec 2024 07:56:53 GMT"} })
106832024-12-21T07:56:53.919ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
106842024-12-21T07:56:53.919ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1cad75c-eefc-4e8a-974d-4c067c18da93", "content-length": "52", "date": "Sat, 21 Dec 2024 07:56:53 GMT"} })
106852024-12-21T07:56:53.919ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
106862024-12-21T07:56:53.919ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
106872024-12-21T07:56:53.927ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "35576b7c-3c6a-4913-9298-68722484eace", "date": "Sat, 21 Dec 2024 07:56:53 GMT"} })
106882024-12-21T07:56:53.927ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106892024-12-21T07:56:53.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106902024-12-21T07:56:53.930ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106912024-12-21T07:56:53.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106922024-12-21T07:56:53.934ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106932024-12-21T07:56:53.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106942024-12-21T07:56:53.937ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
106952024-12-21T07:56:53.937ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
106962024-12-21T07:56:53.939ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0ca10a81-5dab-4372-ade6-888b4b2eaa9a", "date": "Sat, 21 Dec 2024 07:56:53 GMT"} })
106972024-12-21T07:56:53.941ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 429.947645ms iteration = 21 status = {}
106982024-12-21T07:56:54.020ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b48bcbbc-3c05-4929-b180-a8500e77397c", "date": "Sat, 21 Dec 2024 07:56:53 GMT"} })
106992024-12-21T07:56:54.020ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
107002024-12-21T07:56:54.020ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
107012024-12-21T07:56:54.025ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "bff77d57-7074-4ea9-bf69-8ee3d44c7d96", "content-length": "682", "date": "Sat, 21 Dec 2024 07:56:54 GMT"} })
107022024-12-21T07:56:54.025ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107032024-12-21T07:56:54.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107042024-12-21T07:56:54.028ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107052024-12-21T07:56:54.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107062024-12-21T07:56:54.032ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107072024-12-21T07:56:54.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107082024-12-21T07:56:54.034ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107092024-12-21T07:56:54.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107102024-12-21T07:56:54.042ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 530.977457ms iteration = 20 status = {}
107112024-12-21T07:56:54.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = dc59b4c6-2505-4074-856b-3b2a0557db89 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
107122024-12-21T07:56:54.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = dc59b4c6-2505-4074-856b-3b2a0557db89 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
107132024-12-21T07:56:54.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3332 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = dc59b4c6-2505-4074-856b-3b2a0557db89 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
107142024-12-21T07:56:55.900ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1149 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 5efa5d80-840d-4433-af9b-8e5c24654049 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
107152024-12-21T07:57:03.510ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
107162024-12-21T07:57:03.510ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
107172024-12-21T07:57:03.510ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107182024-12-21T07:57:03.510ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107192024-12-21T07:57:03.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107202024-12-21T07:57:03.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107212024-12-21T07:57:03.512ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107222024-12-21T07:57:03.514ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
107232024-12-21T07:57:03.514ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107242024-12-21T07:57:03.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107252024-12-21T07:57:03.516ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107262024-12-21T07:57:03.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107272024-12-21T07:57:03.521ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107282024-12-21T07:57:03.525ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
107292024-12-21T07:57:03.525ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107302024-12-21T07:57:03.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107312024-12-21T07:57:03.539ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
107322024-12-21T07:57:03.539ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.948576ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
107332024-12-21T07:57:03.546ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107342024-12-21T07:57:03.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107352024-12-21T07:57:03.574ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.423815ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
107362024-12-21T07:57:05.901ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1250 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 3891a8ec-4e49-446e-84fa-14aac783dd6a response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
107372024-12-21T07:57:13.510ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
107382024-12-21T07:57:13.510ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107392024-12-21T07:57:13.510ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
107402024-12-21T07:57:13.510ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107412024-12-21T07:57:13.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107422024-12-21T07:57:13.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107432024-12-21T07:57:13.512ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107442024-12-21T07:57:13.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107452024-12-21T07:57:13.512ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107462024-12-21T07:57:13.515ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
107472024-12-21T07:57:13.515ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107482024-12-21T07:57:13.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107492024-12-21T07:57:13.517ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107502024-12-21T07:57:13.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107512024-12-21T07:57:13.519ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107522024-12-21T07:57:13.521ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
107532024-12-21T07:57:13.521ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107542024-12-21T07:57:13.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107552024-12-21T07:57:13.532ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
107562024-12-21T07:57:13.532ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.263252ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
107572024-12-21T07:57:13.541ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.997691ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
107582024-12-21T07:57:15.901ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1122 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = eafff8d4-f711-49c5-bfa6-5a7ed6d7b7f9 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
107592024-12-21T07:57:20.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = b34f7b20-35dc-43b0-8d49-6c46dd79da7b roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
107602024-12-21T07:57:20.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = b34f7b20-35dc-43b0-8d49-6c46dd79da7b resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
107612024-12-21T07:57:20.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3065 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = b34f7b20-35dc-43b0-8d49-6c46dd79da7b response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
107622024-12-21T07:57:20.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 6891e624-d53a-4108-9eed-73ee90176cfd roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
107632024-12-21T07:57:20.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 6891e624-d53a-4108-9eed-73ee90176cfd resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
107642024-12-21T07:57:20.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2742 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 6891e624-d53a-4108-9eed-73ee90176cfd response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
107652024-12-21T07:57:23.509ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
107662024-12-21T07:57:23.509ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
107672024-12-21T07:57:23.509ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
107682024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
107692024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
107702024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
107712024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
107722024-12-21T07:57:23.510ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
107732024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
107742024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
107752024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
107762024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
107772024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
107782024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107792024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
107802024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
107812024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
107822024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
107832024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
107842024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107852024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
107862024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
107872024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
107882024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107892024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
107902024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
107912024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
107922024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
107932024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
107942024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
107952024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107962024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
107972024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
107982024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
107992024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
108002024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
108012024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
108022024-12-21T07:57:23.510ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
108032024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
108042024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108052024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
108062024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
108072024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
108082024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
108092024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
108102024-12-21T07:57:23.510ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 3f45718f-9869-448a-a087-788e66db5e9d
108112024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.8\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"3f45718f-9869-448a-a087-788e66db5e9d"}
108122024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
108132024-12-21T07:57:23.510ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
108142024-12-21T07:57:23.510ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:47:23.510894168 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
108152024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
108162024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
108172024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
108182024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
108192024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
108202024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
108212024-12-21T07:57:23.511ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
108222024-12-21T07:57:23.511ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
108232024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
108242024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
108252024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108262024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
108272024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
108282024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
108292024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
108302024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
108312024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
108322024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
108332024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
108342024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
108352024-12-21T07:57:23.511ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
108362024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108372024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
108382024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
108392024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108402024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
108412024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
108422024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
108432024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108442024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108452024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
108462024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
108472024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108482024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108492024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
108502024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
108512024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
108522024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
108532024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
108542024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
108552024-12-21T07:57:23.511ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
108562024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
108572024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108582024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
108592024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
108602024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108612024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
108622024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
108632024-12-21T07:57:23.511ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1595c632-cfae-4f6b-937d-d413dd8cf0b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1563, tv_nsec: 458861744 } })
108642024-12-21T07:57:23.511ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("481de7e8-0737-474b-8c33-e6e8bc6477be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("683a9892-43cd-4dd8-a983-26cccd988df0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1563, tv_nsec: 458862544 } })
108652024-12-21T07:57:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
108662024-12-21T07:57:23.512ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
108672024-12-21T07:57:23.512ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.420575ms iteration = 12 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
108682024-12-21T07:57:23.512ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
108692024-12-21T07:57:23.512ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.71581ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
108702024-12-21T07:57:23.515ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108712024-12-21T07:57:23.516ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
108722024-12-21T07:57:23.516ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.722428ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
108732024-12-21T07:57:23.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
108742024-12-21T07:57:23.517ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.868368ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
108752024-12-21T07:57:23.517ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
108762024-12-21T07:57:23.517ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
108772024-12-21T07:57:23.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
108782024-12-21T07:57:23.522ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108792024-12-21T07:57:23.523ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108802024-12-21T07:57:23.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108812024-12-21T07:57:23.526ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
108822024-12-21T07:57:23.526ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
108832024-12-21T07:57:23.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
108842024-12-21T07:57:23.530ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:47:23.510894168 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
108852024-12-21T07:57:23.530ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 19.783629ms iteration = 11 status = {"expiration":"2024-12-21T07:47:23.510894168Z","pruned":[]}
108862024-12-21T07:57:23.534ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 23.619995ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
108872024-12-21T07:57:23.537ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1563, tv_nsec: 484955871 } })
108882024-12-21T07:57:23.538ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
108892024-12-21T07:57:23.539ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108902024-12-21T07:57:23.539ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1563, tv_nsec: 486927565 } })
108912024-12-21T07:57:23.540ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
108922024-12-21T07:57:23.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
108932024-12-21T07:57:23.546ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108942024-12-21T07:57:23.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
108952024-12-21T07:57:23.568ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 58.29421ms iteration = 21 status = {"errors":[],"finish_invoked_ok":[]}
108962024-12-21T07:57:23.570ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108972024-12-21T07:57:23.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108982024-12-21T07:57:23.575ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
108992024-12-21T07:57:23.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
109002024-12-21T07:57:23.579ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
109012024-12-21T07:57:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
109022024-12-21T07:57:23.580ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109032024-12-21T07:57:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109042024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109052024-12-21T07:57:23.583ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
109062024-12-21T07:57:23.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
109072024-12-21T07:57:23.585ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109082024-12-21T07:57:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109092024-12-21T07:57:23.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
109102024-12-21T07:57:23.587ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109112024-12-21T07:57:23.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109122024-12-21T07:57:23.588ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109132024-12-21T07:57:23.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109142024-12-21T07:57:23.590ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109152024-12-21T07:57:23.591ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 80.646113ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
109162024-12-21T07:57:23.591ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
109172024-12-21T07:57:23.591ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
109182024-12-21T07:57:23.591ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 81.113732ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
109192024-12-21T07:57:23.594ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1563, tv_nsec: 541222516 } })
109202024-12-21T07:57:23.594ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
109212024-12-21T07:57:23.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
109222024-12-21T07:57:23.594ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
109232024-12-21T07:57:23.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
109242024-12-21T07:57:23.595ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109252024-12-21T07:57:23.595ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
109262024-12-21T07:57:23.595ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
109272024-12-21T07:57:23.595ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
109282024-12-21T07:57:23.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
109292024-12-21T07:57:23.598ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
109302024-12-21T07:57:23.598ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = f315012a-bc11-4c37-83c5-c2e540283251
109312024-12-21T07:57:23.598ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5
109322024-12-21T07:57:23.599ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2
109332024-12-21T07:57:23.599ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 28ef99c9-5b09-4290-b272-ae68fcf381f5
109342024-12-21T07:57:23.599ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 8c32b9b7-2f0c-4679-a2a0-ac4dddcf1bf2
109352024-12-21T07:57:23.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
109362024-12-21T07:57:23.599ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
109372024-12-21T07:57:23.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
109382024-12-21T07:57:23.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109392024-12-21T07:57:23.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
109402024-12-21T07:57:23.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109412024-12-21T07:57:23.606ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109422024-12-21T07:57:23.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109432024-12-21T07:57:23.606ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
109442024-12-21T07:57:23.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
109452024-12-21T07:57:23.610ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = f315012a-bc11-4c37-83c5-c2e540283251
109462024-12-21T07:57:23.610ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 99.478696ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":3,"recent_failures":[],"recent_recoveries":[]}
109472024-12-21T07:57:23.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
109482024-12-21T07:57:23.610ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
109492024-12-21T07:57:23.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
109502024-12-21T07:57:23.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109512024-12-21T07:57:23.615ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109522024-12-21T07:57:23.615ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109532024-12-21T07:57:23.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109542024-12-21T07:57:23.616ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
109552024-12-21T07:57:23.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
109562024-12-21T07:57:23.618ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
109572024-12-21T07:57:23.618ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
109582024-12-21T07:57:23.618ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
109592024-12-21T07:57:23.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
109602024-12-21T07:57:23.619ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
109612024-12-21T07:57:23.619ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
109622024-12-21T07:57:23.619ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
109632024-12-21T07:57:23.619ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109642024-12-21T07:57:23.619ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
109652024-12-21T07:57:23.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
109662024-12-21T07:57:23.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109672024-12-21T07:57:23.621ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
109682024-12-21T07:57:23.621ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 110.77666ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
109692024-12-21T07:57:23.623ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
109702024-12-21T07:57:23.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
109712024-12-21T07:57:23.630ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109722024-12-21T07:57:23.633ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109732024-12-21T07:57:23.635ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109742024-12-21T07:57:23.635ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
109752024-12-21T07:57:23.635ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109762024-12-21T07:57:23.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109772024-12-21T07:57:23.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
109782024-12-21T07:57:23.637ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
109792024-12-21T07:57:23.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
109802024-12-21T07:57:23.639ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
109812024-12-21T07:57:23.639ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109822024-12-21T07:57:23.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109832024-12-21T07:57:23.654ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109842024-12-21T07:57:23.655ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
109852024-12-21T07:57:23.655ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
109862024-12-21T07:57:23.655ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
109872024-12-21T07:57:23.655ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
109882024-12-21T07:57:23.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
109892024-12-21T07:57:23.656ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
109902024-12-21T07:57:23.656ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
109912024-12-21T07:57:23.656ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 146.154607ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
109922024-12-21T07:57:23.658ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
109932024-12-21T07:57:23.658ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
109942024-12-21T07:57:23.658ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
109952024-12-21T07:57:23.658ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
109962024-12-21T07:57:23.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
109972024-12-21T07:57:23.659ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
109982024-12-21T07:57:23.659ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
109992024-12-21T07:57:23.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
110002024-12-21T07:57:23.660ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
110012024-12-21T07:57:23.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
110022024-12-21T07:57:23.662ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110032024-12-21T07:57:23.663ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110042024-12-21T07:57:23.665ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 154.387188ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
110052024-12-21T07:57:23.665ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
110062024-12-21T07:57:23.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
110072024-12-21T07:57:23.668ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
110082024-12-21T07:57:23.668ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
110092024-12-21T07:57:23.668ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
110102024-12-21T07:57:23.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
110112024-12-21T07:57:23.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
110122024-12-21T07:57:23.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
110132024-12-21T07:57:23.669ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
110142024-12-21T07:57:23.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
110152024-12-21T07:57:23.672ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110162024-12-21T07:57:23.676ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
110172024-12-21T07:57:23.676ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
110182024-12-21T07:57:23.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
110192024-12-21T07:57:23.686ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
110202024-12-21T07:57:23.686ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 175.248686ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
110212024-12-21T07:57:23.694ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110222024-12-21T07:57:23.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110232024-12-21T07:57:23.703ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110242024-12-21T07:57:23.703ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110252024-12-21T07:57:23.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
110262024-12-21T07:57:23.708ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
110272024-12-21T07:57:23.708ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110282024-12-21T07:57:23.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110292024-12-21T07:57:23.708ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110302024-12-21T07:57:23.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
110312024-12-21T07:57:23.711ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110322024-12-21T07:57:23.714ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
110332024-12-21T07:57:23.716ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
110342024-12-21T07:57:23.716ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110352024-12-21T07:57:23.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
110362024-12-21T07:57:23.720ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 209.780658ms iteration = 21 status = 0
110372024-12-21T07:57:23.723ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
110382024-12-21T07:57:23.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
110392024-12-21T07:57:23.728ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
110402024-12-21T07:57:23.728ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
110412024-12-21T07:57:23.728ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 217.061443ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
110422024-12-21T07:57:23.728ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 217.496981ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
110432024-12-21T07:57:23.737ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 227.037294ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
110442024-12-21T07:57:23.744ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
110452024-12-21T07:57:23.744ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 0 version = 2
110462024-12-21T07:57:23.744ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
110472024-12-21T07:57:23.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
110482024-12-21T07:57:23.746ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
110492024-12-21T07:57:23.746ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
110502024-12-21T07:57:23.746ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
110512024-12-21T07:57:23.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
110522024-12-21T07:57:23.748ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110532024-12-21T07:57:23.749ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110542024-12-21T07:57:23.752ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
110552024-12-21T07:57:23.752ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
110562024-12-21T07:57:23.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
110572024-12-21T07:57:23.754ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
110582024-12-21T07:57:23.754ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
110592024-12-21T07:57:23.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
110602024-12-21T07:57:23.754ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 1 version = 2
110612024-12-21T07:57:23.754ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
110622024-12-21T07:57:23.754ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 07:47:25.290148 UTC dns_group = external generation = 2
110632024-12-21T07:57:23.754ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 244.27433ms iteration = 12 status = {"generation":2}
110642024-12-21T07:57:23.758ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
110652024-12-21T07:57:23.758ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
110662024-12-21T07:57:23.758ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 07:47:23.936594 UTC dns_group = internal generation = 1
110672024-12-21T07:57:23.758ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 248.376491ms iteration = 12 status = {"generation":1}
110682024-12-21T07:57:23.765ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:47:21.583817Z, time_modified: 2024-12-21T07:47:21.583817Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }) }
110692024-12-21T07:57:23.765ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 254.855212ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]}},"default_endpoint":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
110702024-12-21T07:57:23.771ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110712024-12-21T07:57:23.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110722024-12-21T07:57:23.776ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110732024-12-21T07:57:23.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110742024-12-21T07:57:23.777ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
110752024-12-21T07:57:23.777ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
110762024-12-21T07:57:23.778ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb5236ee-3da1-49b7-b71b-0144182166ef", "content-length": "26", "date": "Sat, 21 Dec 2024 07:57:23 GMT"} })
110772024-12-21T07:57:23.778ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
110782024-12-21T07:57:23.778ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110792024-12-21T07:57:23.780ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
110802024-12-21T07:57:23.783ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
110812024-12-21T07:57:23.783ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110822024-12-21T07:57:23.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110832024-12-21T07:57:23.786ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110842024-12-21T07:57:23.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110852024-12-21T07:57:23.807ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(61de7a61-ac32-4049-9cbe-3673f32e1c5d, 0), (32aca71e-b39b-47ab-a2c7-b9f0a55c8abc, 0), (5f3bb63b-9a4d-4736-bd96-e6dbe3cd134e, 0), (a343033c-6f51-4865-a2d3-691517e8a95f, 0)] collection_id = 61de7a61-ac32-4049-9cbe-3673f32e1c5d
110862024-12-21T07:57:23.807ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
110872024-12-21T07:57:23.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
110882024-12-21T07:57:23.823ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 312.280046ms iteration = 23 status = {"physical_disks_added":0}
110892024-12-21T07:57:23.823ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
110902024-12-21T07:57:23.823ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 312.793915ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
110912024-12-21T07:57:23.851ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
110922024-12-21T07:57:23.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
110932024-12-21T07:57:23.924ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
110942024-12-21T07:57:23.924ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
110952024-12-21T07:57:23.925ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8adcd5b-ea46-42b4-9944-f722be06fef2", "content-length": "26", "date": "Sat, 21 Dec 2024 07:57:23 GMT"} })
110962024-12-21T07:57:23.925ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
110972024-12-21T07:57:23.926ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
110982024-12-21T07:57:23.928ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
110992024-12-21T07:57:23.948ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
111002024-12-21T07:57:23.948ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
111012024-12-21T07:57:23.948ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "95d62b5e-52ab-4e73-a21e-ca01c4fb63dd", "content-length": "26", "date": "Sat, 21 Dec 2024 07:57:23 GMT"} })
111022024-12-21T07:57:23.948ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
111032024-12-21T07:57:23.950ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
111042024-12-21T07:57:23.953ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 442.499069ms iteration = 21 status = {}
111052024-12-21T07:57:24.007ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
111062024-12-21T07:57:24.007ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "9f0ab7d0-a243-479b-b868-189c340bb7b6", "date": "Sat, 21 Dec 2024 07:57:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
111072024-12-21T07:57:24.007ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
111082024-12-21T07:57:24.010ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "dfb66961-e777-424e-b67e-ce9d208586ed", "date": "Sat, 21 Dec 2024 07:57:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
111092024-12-21T07:57:24.010ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
111102024-12-21T07:57:24.011ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
111112024-12-21T07:57:24.011ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 500.937992ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
111122024-12-21T07:57:24.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 488293ae-ce6e-4029-a348-7c5daf53a925 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
111132024-12-21T07:57:24.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 488293ae-ce6e-4029-a348-7c5daf53a925 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
111142024-12-21T07:57:24.070ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
111152024-12-21T07:57:24.070ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
111162024-12-21T07:57:24.071ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "11670170-d30f-4811-bb6f-422805e07778", "content-length": "372", "date": "Sat, 21 Dec 2024 07:57:23 GMT"} })
111172024-12-21T07:57:24.071ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111182024-12-21T07:57:24.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111192024-12-21T07:57:24.073ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111202024-12-21T07:57:24.073ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111212024-12-21T07:57:24.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111222024-12-21T07:57:24.076ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111232024-12-21T07:57:24.076ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
111242024-12-21T07:57:24.076ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
111252024-12-21T07:57:24.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54557 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 488293ae-ce6e-4029-a348-7c5daf53a925 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
111262024-12-21T07:57:24.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111272024-12-21T07:57:24.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
111282024-12-21T07:57:24.080ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111292024-12-21T07:57:24.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111302024-12-21T07:57:24.080ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111312024-12-21T07:57:24.082ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
111322024-12-21T07:57:24.082ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
111332024-12-21T07:57:24.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
111342024-12-21T07:57:24.083ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111352024-12-21T07:57:24.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111362024-12-21T07:57:24.085ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111372024-12-21T07:57:24.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111382024-12-21T07:57:24.086ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
111392024-12-21T07:57:24.087ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "08621d85-d40c-4bb1-b4cf-a7438d118cd4", "content-length": "1", "date": "Sat, 21 Dec 2024 07:57:23 GMT"} })
111402024-12-21T07:57:24.088ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
111412024-12-21T07:57:24.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
111422024-12-21T07:57:24.090ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 579.633632ms iteration = 21 status = null
111432024-12-21T07:57:24.099ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 61de7a61-ac32-4049-9cbe-3673f32e1c5d file = nexus/db-queries/src/db/datastore/inventory.rs:1442 ncabooses = 0 nclickhouse_keeper_membership = 0 ncollections = 0 ndatasets = 0 nerrors = 0 nnics = 0 nnvme_disk_firmware = 0 nphysical_disks = 0 nrot_pages = 0 nrots = 0 nsled_agent_zones = 0 nsled_agents = 0 nsps = 0 nzones = 0 nzpools = 0
111442024-12-21T07:57:24.099ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
111452024-12-21T07:57:24.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
111462024-12-21T07:57:24.107ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(32aca71e-b39b-47ab-a2c7-b9f0a55c8abc, 0), (5f3bb63b-9a4d-4736-bd96-e6dbe3cd134e, 0), (a343033c-6f51-4865-a2d3-691517e8a95f, 0)]
111472024-12-21T07:57:24.108ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1564, tv_nsec: 55629179 } })
111482024-12-21T07:57:24.114ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111492024-12-21T07:57:24.115ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
111502024-12-21T07:57:24.116ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "112c663d-b208-4b38-bc07-34a762dc0882", "date": "Sat, 21 Dec 2024 07:57:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
111512024-12-21T07:57:24.116ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
111522024-12-21T07:57:24.118ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "e0421dad-fa99-4215-ab60-bd3149214ae2", "date": "Sat, 21 Dec 2024 07:57:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
111532024-12-21T07:57:24.118ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
111542024-12-21T07:57:24.118ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
111552024-12-21T07:57:24.118ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111562024-12-21T07:57:24.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111572024-12-21T07:57:24.119ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "dd77bc52-532c-4c7c-9407-b9069baf5baf", "date": "Sat, 21 Dec 2024 07:57:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
111582024-12-21T07:57:24.119ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
111592024-12-21T07:57:24.120ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111602024-12-21T07:57:24.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111612024-12-21T07:57:24.121ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
111622024-12-21T07:57:24.121ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 611.337966ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
111632024-12-21T07:57:24.123ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111642024-12-21T07:57:24.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111652024-12-21T07:57:24.126ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111662024-12-21T07:57:24.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111672024-12-21T07:57:24.129ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111682024-12-21T07:57:24.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111692024-12-21T07:57:24.131ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111702024-12-21T07:57:24.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111712024-12-21T07:57:24.133ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111722024-12-21T07:57:24.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111732024-12-21T07:57:24.135ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111742024-12-21T07:57:24.135ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
111752024-12-21T07:57:24.135ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
111762024-12-21T07:57:24.139ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
111772024-12-21T07:57:24.139ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111782024-12-21T07:57:24.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111792024-12-21T07:57:24.141ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111802024-12-21T07:57:24.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111812024-12-21T07:57:24.142ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111822024-12-21T07:57:24.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111832024-12-21T07:57:24.144ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111842024-12-21T07:57:24.147ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
111852024-12-21T07:57:24.147ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111862024-12-21T07:57:24.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111872024-12-21T07:57:24.152ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111882024-12-21T07:57:24.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111892024-12-21T07:57:24.153ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
111902024-12-21T07:57:24.153ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
111912024-12-21T07:57:24.153ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
111922024-12-21T07:57:24.153ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae2e12ff-2ab1-4280-8234-2efede3ec600", "content-length": "476", "date": "Sat, 21 Dec 2024 07:57:23 GMT"} })
111932024-12-21T07:57:24.153ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
111942024-12-21T07:57:24.154ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c07d8ae-7d32-463d-929e-f56dcc102d95", "content-length": "734", "date": "Sat, 21 Dec 2024 07:57:23 GMT"} })
111952024-12-21T07:57:24.154ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
111962024-12-21T07:57:24.154ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d51f820-3c2e-4eeb-8426-d2d41b84dede", "content-length": "111", "date": "Sat, 21 Dec 2024 07:57:23 GMT"} })
111972024-12-21T07:57:24.154ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
111982024-12-21T07:57:24.155ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111992024-12-21T07:57:24.155ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "adbad28b-7f07-407c-8487-afcc34af9b6f", "content-length": "111", "date": "Sat, 21 Dec 2024 07:57:23 GMT"} })
112002024-12-21T07:57:24.155ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
112012024-12-21T07:57:24.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112022024-12-21T07:57:24.155ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6839ddb-3b4a-4fdf-814d-5aef9e6cf371", "content-length": "167", "date": "Sat, 21 Dec 2024 07:57:23 GMT"} })
112032024-12-21T07:57:24.155ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
112042024-12-21T07:57:24.155ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5c4c9a9-c3c6-44e3-8301-5464650a9cff", "content-length": "167", "date": "Sat, 21 Dec 2024 07:57:23 GMT"} })
112052024-12-21T07:57:24.155ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
112062024-12-21T07:57:24.156ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ebb6374-3cfc-4867-a1f5-db1f488e2fb6", "content-length": "175", "date": "Sat, 21 Dec 2024 07:57:23 GMT"} })
112072024-12-21T07:57:24.156ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
112082024-12-21T07:57:24.156ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b74f16f4-1e6e-48f3-aa76-8673993084e1", "content-length": "175", "date": "Sat, 21 Dec 2024 07:57:23 GMT"} })
112092024-12-21T07:57:24.156ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
112102024-12-21T07:57:24.156ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c602799-2ad1-4959-a376-3465d68ce547", "content-length": "702", "date": "Sat, 21 Dec 2024 07:57:23 GMT"} })
112112024-12-21T07:57:24.156ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
112122024-12-21T07:57:24.156ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f421e2f-69a3-4321-9603-9cf252560879", "content-length": "727", "date": "Sat, 21 Dec 2024 07:57:23 GMT"} })
112132024-12-21T07:57:24.156ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
112142024-12-21T07:57:24.157ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d199c77d-59d9-40f5-8662-db8298928296", "content-length": "729", "date": "Sat, 21 Dec 2024 07:57:23 GMT"} })
112152024-12-21T07:57:24.157ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
112162024-12-21T07:57:24.159ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3361766d-f319-4743-9d74-7fe9e9946984", "content-length": "728", "date": "Sat, 21 Dec 2024 07:57:24 GMT"} })
112172024-12-21T07:57:24.159ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
112182024-12-21T07:57:24.159ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "380f48e7-47b8-4ce7-9fa1-7194d0cdee15", "content-length": "722", "date": "Sat, 21 Dec 2024 07:57:24 GMT"} })
112192024-12-21T07:57:24.159ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
112202024-12-21T07:57:24.159ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112212024-12-21T07:57:24.160ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2fcdb22-9da0-4921-88e0-34a9e0a96c44", "content-length": "109", "date": "Sat, 21 Dec 2024 07:57:24 GMT"} })
112222024-12-21T07:57:24.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112232024-12-21T07:57:24.160ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
112242024-12-21T07:57:24.160ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d23b6fec-ccf6-45c3-b4a5-34e03f107611", "content-length": "109", "date": "Sat, 21 Dec 2024 07:57:24 GMT"} })
112252024-12-21T07:57:24.160ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
112262024-12-21T07:57:24.160ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6fa726ea-df3a-42e4-aa1d-7071a97fe28e", "content-length": "169", "date": "Sat, 21 Dec 2024 07:57:24 GMT"} })
112272024-12-21T07:57:24.160ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
112282024-12-21T07:57:24.161ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e3656f9-b816-4d5b-9bb8-efeef86f568d", "content-length": "169", "date": "Sat, 21 Dec 2024 07:57:24 GMT"} })
112292024-12-21T07:57:24.161ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
112302024-12-21T07:57:24.161ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b87bf5d-2d89-48b6-8d43-fad6fc3d235b", "content-length": "178", "date": "Sat, 21 Dec 2024 07:57:24 GMT"} })
112312024-12-21T07:57:24.161ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
112322024-12-21T07:57:24.161ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "70e3d4e8-5d0c-4b65-a471-8f063860042d", "content-length": "178", "date": "Sat, 21 Dec 2024 07:57:24 GMT"} })
112332024-12-21T07:57:24.161ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
112342024-12-21T07:57:24.162ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bcff3a9d-e396-47ab-9b1e-fc7e19a77e20", "content-length": "702", "date": "Sat, 21 Dec 2024 07:57:24 GMT"} })
112352024-12-21T07:57:24.162ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
112362024-12-21T07:57:24.162ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "16a52cee-f3ea-4f8c-8fec-cc1de3ba34d8", "content-length": "727", "date": "Sat, 21 Dec 2024 07:57:24 GMT"} })
112372024-12-21T07:57:24.162ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
112382024-12-21T07:57:24.162ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4155f778-7387-477f-841e-ee01b38df883", "content-length": "729", "date": "Sat, 21 Dec 2024 07:57:24 GMT"} })
112392024-12-21T07:57:24.162ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
112402024-12-21T07:57:24.162ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "eef91422-e206-4a05-8aff-a4d4f53986c0", "content-length": "728", "date": "Sat, 21 Dec 2024 07:57:24 GMT"} })
112412024-12-21T07:57:24.162ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
112422024-12-21T07:57:24.162ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112432024-12-21T07:57:24.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
112442024-12-21T07:57:24.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112452024-12-21T07:57:24.164ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112462024-12-21T07:57:24.166ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
112472024-12-21T07:57:24.166ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
112482024-12-21T07:57:24.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
112492024-12-21T07:57:24.179ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112502024-12-21T07:57:24.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112512024-12-21T07:57:24.201ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
112522024-12-21T07:57:24.203ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112532024-12-21T07:57:24.203ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112542024-12-21T07:57:24.204ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
112552024-12-21T07:57:24.204ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112562024-12-21T07:57:24.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112572024-12-21T07:57:24.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112582024-12-21T07:57:24.205ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
112592024-12-21T07:57:24.205ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
112602024-12-21T07:57:24.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
112612024-12-21T07:57:24.205ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112622024-12-21T07:57:24.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112632024-12-21T07:57:24.207ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112642024-12-21T07:57:24.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112652024-12-21T07:57:24.209ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112662024-12-21T07:57:24.212ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
112672024-12-21T07:57:24.212ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112682024-12-21T07:57:24.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112692024-12-21T07:57:24.213ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112702024-12-21T07:57:24.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112712024-12-21T07:57:24.214ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
112722024-12-21T07:57:24.215ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff98037c-7913-4f2b-9b99-65fb12c685a4", "content-length": "134", "date": "Sat, 21 Dec 2024 07:57:23 GMT"} })
112732024-12-21T07:57:24.215ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
112742024-12-21T07:57:24.215ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
112752024-12-21T07:57:24.215ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
112762024-12-21T07:57:24.215ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
112772024-12-21T07:57:24.215ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
112782024-12-21T07:57:24.215ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
112792024-12-21T07:57:24.215ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
112802024-12-21T07:57:24.215ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
112812024-12-21T07:57:24.215ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
112822024-12-21T07:57:24.215ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
112832024-12-21T07:57:24.215ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
112842024-12-21T07:57:24.215ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112852024-12-21T07:57:24.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112862024-12-21T07:57:24.245ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
112872024-12-21T07:57:24.245ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
112882024-12-21T07:57:24.246ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6c2149af-987b-468f-be11-573e6e0379dd", "date": "Sat, 21 Dec 2024 07:57:23 GMT"} })
112892024-12-21T07:57:24.246ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112902024-12-21T07:57:24.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112912024-12-21T07:57:24.246ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f1e450d-dab3-4de6-8e7b-008ba393950a", "content-length": "691", "date": "Sat, 21 Dec 2024 07:57:24 GMT"} })
112922024-12-21T07:57:24.246ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
112932024-12-21T07:57:24.246ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
112942024-12-21T07:57:24.246ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
112952024-12-21T07:57:24.248ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
112962024-12-21T07:57:24.248ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "835f38e8-23cf-4612-ae5a-86279aa2e307", "content-length": "2", "date": "Sat, 21 Dec 2024 07:57:23 GMT"} })
112972024-12-21T07:57:24.248ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
112982024-12-21T07:57:24.248ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9fb53646-8edd-4f97-aaf0-8a9a976140ee", "content-length": "52", "date": "Sat, 21 Dec 2024 07:57:23 GMT"} })
112992024-12-21T07:57:24.248ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
113002024-12-21T07:57:24.248ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
113012024-12-21T07:57:24.248ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 737.970957ms iteration = 21 status = {}
113022024-12-21T07:57:24.249ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113032024-12-21T07:57:24.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113042024-12-21T07:57:24.250ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113052024-12-21T07:57:24.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113062024-12-21T07:57:24.252ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113072024-12-21T07:57:24.253ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113082024-12-21T07:57:24.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113092024-12-21T07:57:24.256ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
113102024-12-21T07:57:24.256ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113112024-12-21T07:57:24.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113122024-12-21T07:57:24.258ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
113132024-12-21T07:57:24.258ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
113142024-12-21T07:57:24.260ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2842ae33-dd71-4b50-9cd6-9f4582aa2575", "date": "Sat, 21 Dec 2024 07:57:24 GMT"} })
113152024-12-21T07:57:24.261ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 750.791657ms iteration = 22 status = {}
113162024-12-21T07:57:24.263ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 95e048ed-0de5-4c3b-a368-18ddaf75c49e, kind: Service { id: 8fbd6070-9acd-409b-bda8-dadf2a05b00e }, name: Name("nexus-8fbd6070-9acd-409b-bda8-dadf2a05b00e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9b744bef-fce0-46ab-93b4-a179a1aaa5aa, kind: Service { id: 4b205886-0970-4a9e-bff0-ae1192504434 }, name: Name("nexus-4b205886-0970-4a9e-bff0-ae1192504434"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c592275e-d41b-414d-af17-bfadf96c8a68, kind: Service { id: 428cd3f9-eecf-4305-9c0b-1698df6403fd }, name: Name("nexus-428cd3f9-eecf-4305-9c0b-1698df6403fd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 528044ef-9437-43f9-b92d-7d435209bb68, kind: Service { id: e6b54c38-8771-4091-8fc3-2bbdae94bd35 }, name: Name("external-dns-e6b54c38-8771-4091-8fc3-2bbdae94bd35"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 45])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6b349cca-d953-4887-a151-4eb9ed8779f4, kind: Service { id: 1595c632-cfae-4f6b-937d-d413dd8cf0b7 }, name: Name("external-dns-1595c632-cfae-4f6b-937d-d413dd8cf0b7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
113172024-12-21T07:57:24.263ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113182024-12-21T07:57:24.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113192024-12-21T07:57:24.265ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113202024-12-21T07:57:24.268ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
113212024-12-21T07:57:24.268ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113222024-12-21T07:57:24.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113232024-12-21T07:57:24.270ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
113242024-12-21T07:57:24.270ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 528044ef-9437-43f9-b92d-7d435209bb68, kind: Service { id: e6b54c38-8771-4091-8fc3-2bbdae94bd35 }, name: Name("external-dns-e6b54c38-8771-4091-8fc3-2bbdae94bd35"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 45])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6b349cca-d953-4887-a151-4eb9ed8779f4, kind: Service { id: 1595c632-cfae-4f6b-937d-d413dd8cf0b7 }, name: Name("external-dns-1595c632-cfae-4f6b-937d-d413dd8cf0b7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 95e048ed-0de5-4c3b-a368-18ddaf75c49e, kind: Service { id: 8fbd6070-9acd-409b-bda8-dadf2a05b00e }, name: Name("nexus-8fbd6070-9acd-409b-bda8-dadf2a05b00e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9b744bef-fce0-46ab-93b4-a179a1aaa5aa, kind: Service { id: 4b205886-0970-4a9e-bff0-ae1192504434 }, name: Name("nexus-4b205886-0970-4a9e-bff0-ae1192504434"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c592275e-d41b-414d-af17-bfadf96c8a68, kind: Service { id: 428cd3f9-eecf-4305-9c0b-1698df6403fd }, name: Name("nexus-428cd3f9-eecf-4305-9c0b-1698df6403fd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
113252024-12-21T07:57:24.270ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
113262024-12-21T07:57:24.376ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: c992e3dc-2d80-4655-85d0-78e9a80bf69e, time_created: 2024-12-21T07:47:23.178624Z, time_modified: 2024-12-21T07:47:23.178624Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
113272024-12-21T07:57:24.376ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
113282024-12-21T07:57:24.376ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113292024-12-21T07:57:24.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113302024-12-21T07:57:24.379ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113312024-12-21T07:57:24.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113322024-12-21T07:57:24.381ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113332024-12-21T07:57:24.384ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
113342024-12-21T07:57:24.415ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
113352024-12-21T07:57:24.416ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "208efaca-bede-4346-afff-53a69ba2bb55", "date": "Sat, 21 Dec 2024 07:57:24 GMT"} })
113362024-12-21T07:57:24.416ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
113372024-12-21T07:57:24.416ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 906.131912ms
113382024-12-21T07:57:24.417ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 906.139762ms iteration = 3 status = {}
113392024-12-21T07:57:24.471ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "dd4705cb-986f-4ba2-9d39-a9646a556ab4", "date": "Sat, 21 Dec 2024 07:57:23 GMT"} })
113402024-12-21T07:57:24.471ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
113412024-12-21T07:57:24.471ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
113422024-12-21T07:57:24.472ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "eca3088a-a910-425b-a654-2a4165f2a978", "content-length": "682", "date": "Sat, 21 Dec 2024 07:57:24 GMT"} })
113432024-12-21T07:57:24.472ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113442024-12-21T07:57:24.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113452024-12-21T07:57:24.476ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113462024-12-21T07:57:24.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113472024-12-21T07:57:24.480ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113482024-12-21T07:57:24.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113492024-12-21T07:57:24.483ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113502024-12-21T07:57:24.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113512024-12-21T07:57:24.491ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 980.6573ms iteration = 21 status = {}
113522024-12-21T07:57:24.569ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "698337a3-1c69-4169-a8d4-ad1a1ffb53b7", "content-length": "30798", "date": "Sat, 21 Dec 2024 07:57:24 GMT"} })
113532024-12-21T07:57:24.572ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
113542024-12-21T07:57:24.572ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
113552024-12-21T07:57:24.572ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
113562024-12-21T07:57:24.574ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
113572024-12-21T07:57:24.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
113582024-12-21T07:57:24.575ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113592024-12-21T07:57:24.577ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
113602024-12-21T07:57:24.577ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
113612024-12-21T07:57:24.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
113622024-12-21T07:57:24.750ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = fc6e5c67-f858-4351-a36c-8a96e912581a file = nexus/db-queries/src/db/datastore/inventory.rs:1010
113632024-12-21T07:57:24.750ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = fc6e5c67-f858-4351-a36c-8a96e912581a time_started = 2024-12-21 07:57:24.153228 UTC
113642024-12-21T07:57:24.750ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.239605562s iteration = 3 status = {"collection_id":"fc6e5c67-f858-4351-a36c-8a96e912581a","time_done":"2024-12-21 07:57:24.572249 UTC","time_started":"2024-12-21 07:57:24.153228 UTC"}
113652024-12-21T07:57:24.750ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
113662024-12-21T07:57:24.750ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
113672024-12-21T07:57:24.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
113682024-12-21T07:57:24.752ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113692024-12-21T07:57:24.753ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
113702024-12-21T07:57:24.753ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
113712024-12-21T07:57:24.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
113722024-12-21T07:57:24.756ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
113732024-12-21T07:57:24.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
113742024-12-21T07:57:24.758ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113752024-12-21T07:57:24.759ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
113762024-12-21T07:57:24.759ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
113772024-12-21T07:57:24.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
113782024-12-21T07:57:24.849ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 99.72684ms iteration = 24 status = {"physical_disks_added":0}
113792024-12-21T07:57:25.901ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1139 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = da50b3dd-254d-47e9-8803-dc9c2866f23c response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
113802024-12-21T07:57:26.287ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:56854
113812024-12-21T07:57:26.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56854 req_id = c082927d-616b-4b20-8e06-3f9fe583763a roles = RoleSet { roles: {} } uri = /metrics/producers
113822024-12-21T07:57:26.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56854 req_id = c082927d-616b-4b20-8e06-3f9fe583763a resource = Database result = Ok(()) uri = /metrics/producers
113832024-12-21T07:57:26.322ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = b2e6180f-2896-4592-b155-f5ca3f904fa7
113842024-12-21T07:57:26.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35816 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56854 req_id = c082927d-616b-4b20-8e06-3f9fe583763a response_code = 201 uri = /metrics/producers
113852024-12-21T07:57:26.458ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
113862024-12-21T07:57:26.458ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
113872024-12-21T07:57:26.488ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
113882024-12-21T07:57:26.488ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:39831
113892024-12-21T07:57:26.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:39831 req_id = 9bc69920-96ed-4746-8d4b-8af4ad892d93 roles = RoleSet { roles: {} } uri = /metrics/producers
113902024-12-21T07:57:26.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:39831 req_id = 9bc69920-96ed-4746-8d4b-8af4ad892d93 resource = Database result = Ok(()) uri = /metrics/producers
113912024-12-21T07:57:26.532ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
113922024-12-21T07:57:26.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43696 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:39831 req_id = 9bc69920-96ed-4746-8d4b-8af4ad892d93 response_code = 201 uri = /metrics/producers
113932024-12-21T07:57:26.532ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "9bc69920-96ed-4746-8d4b-8af4ad892d93", "content-length": "41", "date": "Sat, 21 Dec 2024 07:57:26 GMT"} })
113942024-12-21T07:57:26.533ZDEBGnexus (producer-registration-task): registered with nexus successfully
113952024-12-21T07:57:26.533ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
113962024-12-21T07:57:33.510ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
113972024-12-21T07:57:33.511ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
113982024-12-21T07:57:33.511ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113992024-12-21T07:57:33.511ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
114002024-12-21T07:57:33.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114012024-12-21T07:57:33.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
114022024-12-21T07:57:33.512ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114032024-12-21T07:57:33.513ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
114042024-12-21T07:57:33.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
114052024-12-21T07:57:33.515ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
114062024-12-21T07:57:33.515ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114072024-12-21T07:57:33.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114082024-12-21T07:57:33.515ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.548328ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
114092024-12-21T07:57:33.516ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114102024-12-21T07:57:33.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114112024-12-21T07:57:33.518ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114122024-12-21T07:57:33.520ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
114132024-12-21T07:57:33.521ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114142024-12-21T07:57:33.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114152024-12-21T07:57:33.529ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
114162024-12-21T07:57:33.529ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.154982ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
114172024-12-21T07:57:35.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 5e14e46e-92ee-46c1-916f-0f9e4c0d52ae roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
114182024-12-21T07:57:35.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 5e14e46e-92ee-46c1-916f-0f9e4c0d52ae resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
114192024-12-21T07:57:35.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2568 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 5e14e46e-92ee-46c1-916f-0f9e4c0d52ae response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
114202024-12-21T07:57:35.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = ded44a56-5395-442d-b8d6-6f2e2e270216 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
114212024-12-21T07:57:35.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = ded44a56-5395-442d-b8d6-6f2e2e270216 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
114222024-12-21T07:57:35.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1876 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = ded44a56-5395-442d-b8d6-6f2e2e270216 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
114232024-12-21T07:57:35.901ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1241 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 050e0e97-320b-43e1-a690-879360cc9e9d response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
114242024-12-21T07:57:41.133ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:43741
114252024-12-21T07:57:41.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43741 req_id = 3ff4585f-641b-4879-bbcc-191c2ec25b96 roles = RoleSet { roles: {} } uri = /metrics/producers
114262024-12-21T07:57:41.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43741 req_id = 3ff4585f-641b-4879-bbcc-191c2ec25b96 resource = Database result = Ok(()) uri = /metrics/producers
114272024-12-21T07:57:41.143ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = 42bd0fec-23e2-48f9-bdad-7989f94730a0
114282024-12-21T07:57:41.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9810 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43741 req_id = 3ff4585f-641b-4879-bbcc-191c2ec25b96 response_code = 201 uri = /metrics/producers
114292024-12-21T07:57:43.510ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
114302024-12-21T07:57:43.510ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
114312024-12-21T07:57:43.510ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114322024-12-21T07:57:43.510ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
114332024-12-21T07:57:43.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114342024-12-21T07:57:43.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
114352024-12-21T07:57:43.512ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114362024-12-21T07:57:43.513ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
114372024-12-21T07:57:43.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
114382024-12-21T07:57:43.515ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.330595ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
114392024-12-21T07:57:43.515ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
114402024-12-21T07:57:43.515ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114412024-12-21T07:57:43.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114422024-12-21T07:57:43.516ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114432024-12-21T07:57:43.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114442024-12-21T07:57:43.518ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114452024-12-21T07:57:43.521ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
114462024-12-21T07:57:43.521ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114472024-12-21T07:57:43.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114482024-12-21T07:57:43.532ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
114492024-12-21T07:57:43.532ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.188481ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
114502024-12-21T07:57:45.711ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:34353
114512024-12-21T07:57:45.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34353 req_id = 82e0301f-a8ee-4b04-8328-b8c6431d5487 roles = RoleSet { roles: {} } uri = /metrics/producers
114522024-12-21T07:57:45.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34353 req_id = 82e0301f-a8ee-4b04-8328-b8c6431d5487 resource = Database result = Ok(()) uri = /metrics/producers
114532024-12-21T07:57:45.748ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = cae81b8e-6ade-45fa-953a-26f79465611b
114542024-12-21T07:57:45.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37341 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34353 req_id = 82e0301f-a8ee-4b04-8328-b8c6431d5487 response_code = 201 uri = /metrics/producers
114552024-12-21T07:57:45.901ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1302 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 1d2c6f48-57f2-4bf9-afbd-b56b3037ebe0 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
114562024-12-21T07:57:53.511ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
114572024-12-21T07:57:53.511ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
114582024-12-21T07:57:53.511ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
114592024-12-21T07:57:53.511ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
114602024-12-21T07:57:53.511ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
114612024-12-21T07:57:53.511ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
114622024-12-21T07:57:53.511ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
114632024-12-21T07:57:53.511ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
114642024-12-21T07:57:53.511ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
114652024-12-21T07:57:53.511ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
114662024-12-21T07:57:53.511ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114672024-12-21T07:57:53.511ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
114682024-12-21T07:57:53.511ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114692024-12-21T07:57:53.511ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
114702024-12-21T07:57:53.511ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
114712024-12-21T07:57:53.511ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
114722024-12-21T07:57:53.511ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
114732024-12-21T07:57:53.511ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
114742024-12-21T07:57:53.511ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
114752024-12-21T07:57:53.511ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
114762024-12-21T07:57:53.511ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
114772024-12-21T07:57:53.511ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
114782024-12-21T07:57:53.511ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
114792024-12-21T07:57:53.511ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
114802024-12-21T07:57:53.511ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
114812024-12-21T07:57:53.511ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114822024-12-21T07:57:53.511ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
114832024-12-21T07:57:53.511ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
114842024-12-21T07:57:53.511ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
114852024-12-21T07:57:53.511ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
114862024-12-21T07:57:53.511ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
114872024-12-21T07:57:53.511ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114882024-12-21T07:57:53.511ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
114892024-12-21T07:57:53.511ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
114902024-12-21T07:57:53.511ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
114912024-12-21T07:57:53.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
114922024-12-21T07:57:53.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
114932024-12-21T07:57:53.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114942024-12-21T07:57:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114952024-12-21T07:57:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
114962024-12-21T07:57:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
114972024-12-21T07:57:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114982024-12-21T07:57:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
114992024-12-21T07:57:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
115002024-12-21T07:57:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
115012024-12-21T07:57:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
115022024-12-21T07:57:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
115032024-12-21T07:57:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115042024-12-21T07:57:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
115052024-12-21T07:57:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
115062024-12-21T07:57:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
115072024-12-21T07:57:53.514ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115082024-12-21T07:57:53.515ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115092024-12-21T07:57:53.516ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.539498ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
115102024-12-21T07:57:53.516ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115112024-12-21T07:57:53.519ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
115122024-12-21T07:57:53.519ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115132024-12-21T07:57:53.519ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
115142024-12-21T07:57:53.519ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
115152024-12-21T07:57:53.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115162024-12-21T07:57:53.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
115172024-12-21T07:57:53.520ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
115182024-12-21T07:57:53.520ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115192024-12-21T07:57:53.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115202024-12-21T07:57:53.523ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115212024-12-21T07:57:53.524ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
115222024-12-21T07:57:53.525ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1593, tv_nsec: 471831166 } })
115232024-12-21T07:57:53.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
115242024-12-21T07:57:53.525ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
115252024-12-21T07:57:53.526ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
115262024-12-21T07:57:53.526ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
115272024-12-21T07:57:53.526ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
115282024-12-21T07:57:53.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
115292024-12-21T07:57:53.527ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
115302024-12-21T07:57:53.527ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115312024-12-21T07:57:53.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115322024-12-21T07:57:53.528ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115332024-12-21T07:57:53.531ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
115342024-12-21T07:57:53.531ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
115352024-12-21T07:57:53.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
115362024-12-21T07:57:53.534ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1593, tv_nsec: 481113415 } })
115372024-12-21T07:57:53.534ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
115382024-12-21T07:57:53.541ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
115392024-12-21T07:57:53.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
115402024-12-21T07:57:53.542ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115412024-12-21T07:57:53.542ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1593, tv_nsec: 488922569 } })
115422024-12-21T07:57:53.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115432024-12-21T07:57:53.542ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
115442024-12-21T07:57:53.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115452024-12-21T07:57:53.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115462024-12-21T07:57:53.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115472024-12-21T07:57:53.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
115482024-12-21T07:57:53.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115492024-12-21T07:57:53.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115502024-12-21T07:57:53.558ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
115512024-12-21T07:57:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
115522024-12-21T07:57:53.572ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 61.164209ms iteration = 22 status = {"errors":[],"finish_invoked_ok":[]}
115532024-12-21T07:57:53.573ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
115542024-12-21T07:57:53.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
115552024-12-21T07:57:53.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115562024-12-21T07:57:53.575ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 63.646692ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
115572024-12-21T07:57:53.576ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
115582024-12-21T07:57:53.576ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115592024-12-21T07:57:53.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115602024-12-21T07:57:53.578ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115612024-12-21T07:57:53.578ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
115622024-12-21T07:57:53.578ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 67.170962ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
115632024-12-21T07:57:53.580ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
115642024-12-21T07:57:53.580ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115652024-12-21T07:57:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115662024-12-21T07:57:53.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
115672024-12-21T07:57:53.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
115682024-12-21T07:57:53.582ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
115692024-12-21T07:57:53.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
115702024-12-21T07:57:53.586ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
115712024-12-21T07:57:53.586ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
115722024-12-21T07:57:53.586ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
115732024-12-21T07:57:53.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
115742024-12-21T07:57:53.588ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115752024-12-21T07:57:53.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115762024-12-21T07:57:53.590ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115772024-12-21T07:57:53.590ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 79.287209ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
115782024-12-21T07:57:53.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115792024-12-21T07:57:53.592ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115802024-12-21T07:57:53.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
115812024-12-21T07:57:53.596ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115822024-12-21T07:57:53.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115832024-12-21T07:57:53.598ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
115842024-12-21T07:57:53.598ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 86.813358ms iteration = 22 status = 0
115852024-12-21T07:57:53.598ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
115862024-12-21T07:57:53.598ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b4f43e5-85c9-4320-b8f3-599f82496bc8", "content-length": "26", "date": "Sat, 21 Dec 2024 07:57:53 GMT"} })
115872024-12-21T07:57:53.598ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
115882024-12-21T07:57:53.600ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
115892024-12-21T07:57:53.605ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115902024-12-21T07:57:53.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
115912024-12-21T07:57:53.609ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
115922024-12-21T07:57:53.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
115932024-12-21T07:57:53.615ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
115942024-12-21T07:57:53.615ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
115952024-12-21T07:57:53.615ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 104.297539ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
115962024-12-21T07:57:53.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
115972024-12-21T07:57:53.619ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 107.921951ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
115982024-12-21T07:57:53.634ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
115992024-12-21T07:57:53.634ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
116002024-12-21T07:57:53.634ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 122.564582ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
116012024-12-21T07:57:53.638ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 127.015799ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
116022024-12-21T07:57:53.638ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 127.06773ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
116032024-12-21T07:57:53.648ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
116042024-12-21T07:57:53.648ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
116052024-12-21T07:57:53.648ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c6eddee-09e7-4ed0-b8ab-8c09297eb378", "content-length": "26", "date": "Sat, 21 Dec 2024 07:57:53 GMT"} })
116062024-12-21T07:57:53.648ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
116072024-12-21T07:57:53.648ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
116082024-12-21T07:57:53.648ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
116092024-12-21T07:57:53.649ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c742a01d-0323-4ae1-884e-db3c236ae8c1", "content-length": "26", "date": "Sat, 21 Dec 2024 07:57:53 GMT"} })
116102024-12-21T07:57:53.649ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
116112024-12-21T07:57:53.651ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
116122024-12-21T07:57:53.651ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
116132024-12-21T07:57:53.675ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 163.82946ms iteration = 25 status = {"physical_disks_added":0}
116142024-12-21T07:57:53.675ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
116152024-12-21T07:57:53.676ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "99792c9d-3090-42ae-af96-86e9745746af", "content-length": "1", "date": "Sat, 21 Dec 2024 07:57:53 GMT"} })
116162024-12-21T07:57:53.677ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
116172024-12-21T07:57:53.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
116182024-12-21T07:57:53.679ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 167.405961ms iteration = 22 status = null
116192024-12-21T07:57:53.708ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
116202024-12-21T07:57:53.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
116212024-12-21T07:57:53.710ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116222024-12-21T07:57:53.712ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
116232024-12-21T07:57:53.712ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
116242024-12-21T07:57:53.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
116252024-12-21T07:57:53.714ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116262024-12-21T07:57:53.716ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
116272024-12-21T07:57:53.716ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
116282024-12-21T07:57:53.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
116292024-12-21T07:57:53.756ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 245.182846ms iteration = 22 status = {}
116302024-12-21T07:57:53.784ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
116312024-12-21T07:57:53.784ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
116322024-12-21T07:57:53.784ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e5d1c13-4ba0-4c88-80bb-2e9dade44681", "content-length": "372", "date": "Sat, 21 Dec 2024 07:57:53 GMT"} })
116332024-12-21T07:57:53.784ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116342024-12-21T07:57:53.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116352024-12-21T07:57:53.807ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
116362024-12-21T07:57:53.807ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
116372024-12-21T07:57:53.812ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
116382024-12-21T07:57:53.863ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116392024-12-21T07:57:53.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116402024-12-21T07:57:53.865ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
116412024-12-21T07:57:53.865ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116422024-12-21T07:57:53.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116432024-12-21T07:57:53.877ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
116442024-12-21T07:57:53.877ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "11828012-d265-494f-8b18-ba59ed828e2b", "content-length": "134", "date": "Sat, 21 Dec 2024 07:57:53 GMT"} })
116452024-12-21T07:57:53.877ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
116462024-12-21T07:57:53.877ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
116472024-12-21T07:57:53.878ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
116482024-12-21T07:57:53.878ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
116492024-12-21T07:57:53.878ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
116502024-12-21T07:57:53.878ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
116512024-12-21T07:57:53.878ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
116522024-12-21T07:57:53.878ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
116532024-12-21T07:57:53.878ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
116542024-12-21T07:57:53.878ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
116552024-12-21T07:57:53.878ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
116562024-12-21T07:57:53.878ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116572024-12-21T07:57:53.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116582024-12-21T07:57:53.881ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
116592024-12-21T07:57:53.881ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8e192df-bcae-4880-8e4a-0314d24374c3", "content-length": "2", "date": "Sat, 21 Dec 2024 07:57:53 GMT"} })
116602024-12-21T07:57:53.881ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
116612024-12-21T07:57:53.881ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "906fd38d-f3b3-44b5-b295-4aa5cac8846d", "content-length": "52", "date": "Sat, 21 Dec 2024 07:57:53 GMT"} })
116622024-12-21T07:57:53.881ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
116632024-12-21T07:57:53.881ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
116642024-12-21T07:57:53.899ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a0cdcbea-6e1f-483a-8de4-6f9d886a0cb6", "date": "Sat, 21 Dec 2024 07:57:53 GMT"} })
116652024-12-21T07:57:53.899ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116662024-12-21T07:57:53.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116672024-12-21T07:57:53.899ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2dbbc628-3936-4df9-9913-925b2419fd67", "content-length": "691", "date": "Sat, 21 Dec 2024 07:57:53 GMT"} })
116682024-12-21T07:57:53.899ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
116692024-12-21T07:57:53.899ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
116702024-12-21T07:57:53.899ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
116712024-12-21T07:57:53.901ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 390.321224ms iteration = 22 status = {}
116722024-12-21T07:57:53.902ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116732024-12-21T07:57:53.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116742024-12-21T07:57:53.905ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116752024-12-21T07:57:53.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116762024-12-21T07:57:53.907ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
116772024-12-21T07:57:53.907ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
116782024-12-21T07:57:53.908ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "599813d7-1ffa-4c19-bd55-01772d5a35fd", "date": "Sat, 21 Dec 2024 07:57:53 GMT"} })
116792024-12-21T07:57:53.909ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 397.949025ms iteration = 23 status = {}
116802024-12-21T07:57:54.000ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "22019743-dd7a-4634-a989-a7d193db3bf8", "date": "Sat, 21 Dec 2024 07:57:53 GMT"} })
116812024-12-21T07:57:54.000ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
116822024-12-21T07:57:54.000ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
116832024-12-21T07:57:54.005ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4292e1e-7a90-41e6-8c18-ec6422daa373", "content-length": "682", "date": "Sat, 21 Dec 2024 07:57:53 GMT"} })
116842024-12-21T07:57:54.005ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116852024-12-21T07:57:54.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116862024-12-21T07:57:54.009ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116872024-12-21T07:57:54.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116882024-12-21T07:57:54.012ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116892024-12-21T07:57:54.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116902024-12-21T07:57:54.014ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116912024-12-21T07:57:54.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116922024-12-21T07:57:54.020ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 509.152742ms iteration = 22 status = {}
116932024-12-21T07:57:54.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 1fff7926-9d2a-415a-b883-50d0d3dec074 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
116942024-12-21T07:57:54.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 1fff7926-9d2a-415a-b883-50d0d3dec074 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
116952024-12-21T07:57:54.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3200 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 1fff7926-9d2a-415a-b883-50d0d3dec074 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
116962024-12-21T07:57:54.581ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:46059
116972024-12-21T07:57:54.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46059 req_id = 0fc5c4fd-f98f-4c03-b9f5-0d78976c37c7 roles = RoleSet { roles: {} } uri = /metrics/producers
116982024-12-21T07:57:54.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46059 req_id = 0fc5c4fd-f98f-4c03-b9f5-0d78976c37c7 resource = Database result = Ok(()) uri = /metrics/producers
116992024-12-21T07:57:54.593ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e
117002024-12-21T07:57:54.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11891 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46059 req_id = 0fc5c4fd-f98f-4c03-b9f5-0d78976c37c7 response_code = 201 uri = /metrics/producers
117012024-12-21T07:57:55.902ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1158 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 6c1465bf-a125-4654-ad51-da7e3969a440 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
117022024-12-21T07:57:56.282ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:42906
117032024-12-21T07:57:56.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42906 req_id = bcd210df-5045-4779-a924-97e77b57578e roles = RoleSet { roles: {} } uri = /metrics/producers
117042024-12-21T07:57:56.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42906 req_id = bcd210df-5045-4779-a924-97e77b57578e resource = Database result = Ok(()) uri = /metrics/producers
117052024-12-21T07:57:56.311ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = 9ad898a3-6e9f-4617-bdb6-642b625a79d4
117062024-12-21T07:57:56.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29741 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42906 req_id = bcd210df-5045-4779-a924-97e77b57578e response_code = 201 uri = /metrics/producers
117072024-12-21T07:58:03.510ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
117082024-12-21T07:58:03.510ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
117092024-12-21T07:58:03.510ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117102024-12-21T07:58:03.510ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117112024-12-21T07:58:03.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117122024-12-21T07:58:03.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117132024-12-21T07:58:03.512ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117142024-12-21T07:58:03.513ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117152024-12-21T07:58:03.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117162024-12-21T07:58:03.515ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
117172024-12-21T07:58:03.515ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.476607ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
117182024-12-21T07:58:03.515ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117192024-12-21T07:58:03.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117202024-12-21T07:58:03.517ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117212024-12-21T07:58:03.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117222024-12-21T07:58:03.518ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117232024-12-21T07:58:03.521ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
117242024-12-21T07:58:03.521ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117252024-12-21T07:58:03.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117262024-12-21T07:58:03.529ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
117272024-12-21T07:58:03.529ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.972716ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
117282024-12-21T07:58:03.914ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:64102
117292024-12-21T07:58:03.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64102 req_id = 4e06e416-77e3-48cf-b293-ab4a59fa07ef roles = RoleSet { roles: {} } uri = /metrics/producers
117302024-12-21T07:58:03.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64102 req_id = 4e06e416-77e3-48cf-b293-ab4a59fa07ef resource = Database result = Ok(()) uri = /metrics/producers
117312024-12-21T07:58:03.951ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = 34be787b-2c60-4915-afd0-2c1a7062ad84
117322024-12-21T07:58:03.951ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36908 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64102 req_id = 4e06e416-77e3-48cf-b293-ab4a59fa07ef response_code = 201 uri = /metrics/producers
117332024-12-21T07:58:05.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 31e1a43f-beb9-4617-81ca-d42455a91d9a roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
117342024-12-21T07:58:05.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 31e1a43f-beb9-4617-81ca-d42455a91d9a resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
117352024-12-21T07:58:05.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2931 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 31e1a43f-beb9-4617-81ca-d42455a91d9a response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
117362024-12-21T07:58:05.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 36adeef9-7887-400c-bb48-258dc8dd042a roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
117372024-12-21T07:58:05.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 36adeef9-7887-400c-bb48-258dc8dd042a resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
117382024-12-21T07:58:05.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2575 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 36adeef9-7887-400c-bb48-258dc8dd042a response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
117392024-12-21T07:58:05.901ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1412 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = c441f3bd-c72e-4a84-a18f-0e33230afe99 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
117402024-12-21T07:58:13.511ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
117412024-12-21T07:58:13.511ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
117422024-12-21T07:58:13.511ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117432024-12-21T07:58:13.511ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117442024-12-21T07:58:13.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117452024-12-21T07:58:13.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117462024-12-21T07:58:13.513ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117472024-12-21T07:58:13.513ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117482024-12-21T07:58:13.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117492024-12-21T07:58:13.515ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.06061ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
117502024-12-21T07:58:13.515ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
117512024-12-21T07:58:13.515ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117522024-12-21T07:58:13.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117532024-12-21T07:58:13.517ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117542024-12-21T07:58:13.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117552024-12-21T07:58:13.518ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117562024-12-21T07:58:13.521ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
117572024-12-21T07:58:13.521ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117582024-12-21T07:58:13.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117592024-12-21T07:58:13.529ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
117602024-12-21T07:58:13.529ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.532078ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
117612024-12-21T07:58:15.901ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1168 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = d1f50677-42b7-4a4f-97be-dcba03d0d0fa response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
117622024-12-21T07:58:23.510ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
117632024-12-21T07:58:23.510ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
117642024-12-21T07:58:23.510ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
117652024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
117662024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
117672024-12-21T07:58:23.511ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
117682024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
117692024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
117702024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117712024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
117722024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
117732024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
117742024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
117752024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
117762024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
117772024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
117782024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117792024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
117802024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
117812024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
117822024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
117832024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
117842024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117852024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
117862024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
117872024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
117882024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
117892024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
117902024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
117912024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
117922024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
117932024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
117942024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
117952024-12-21T07:58:23.511ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:48:23.511803952 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
117962024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
117972024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
117982024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
117992024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
118002024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
118012024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118022024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
118032024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
118042024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
118052024-12-21T07:58:23.511ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 3f45718f-9869-448a-a087-788e66db5e9d
118062024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
118072024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.981\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"3f45718f-9869-448a-a087-788e66db5e9d"}
118082024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
118092024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
118102024-12-21T07:58:23.511ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
118112024-12-21T07:58:23.512ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
118122024-12-21T07:58:23.512ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
118132024-12-21T07:58:23.512ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
118142024-12-21T07:58:23.512ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
118152024-12-21T07:58:23.512ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
118162024-12-21T07:58:23.512ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
118172024-12-21T07:58:23.512ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
118182024-12-21T07:58:23.512ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
118192024-12-21T07:58:23.512ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
118202024-12-21T07:58:23.512ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
118212024-12-21T07:58:23.512ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
118222024-12-21T07:58:23.512ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
118232024-12-21T07:58:23.512ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
118242024-12-21T07:58:23.512ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
118252024-12-21T07:58:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
118262024-12-21T07:58:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
118272024-12-21T07:58:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118282024-12-21T07:58:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118292024-12-21T07:58:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118302024-12-21T07:58:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
118312024-12-21T07:58:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118322024-12-21T07:58:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
118332024-12-21T07:58:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
118342024-12-21T07:58:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
118352024-12-21T07:58:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
118362024-12-21T07:58:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
118372024-12-21T07:58:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
118382024-12-21T07:58:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
118392024-12-21T07:58:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
118402024-12-21T07:58:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
118412024-12-21T07:58:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
118422024-12-21T07:58:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
118432024-12-21T07:58:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
118442024-12-21T07:58:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
118452024-12-21T07:58:23.512ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
118462024-12-21T07:58:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
118472024-12-21T07:58:23.512ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
118482024-12-21T07:58:23.512ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("481de7e8-0737-474b-8c33-e6e8bc6477be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("683a9892-43cd-4dd8-a983-26cccd988df0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1623, tv_nsec: 459104218 } })
118492024-12-21T07:58:23.512ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1595c632-cfae-4f6b-937d-d413dd8cf0b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1623, tv_nsec: 459134438 } })
118502024-12-21T07:58:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
118512024-12-21T07:58:23.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
118522024-12-21T07:58:23.513ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
118532024-12-21T07:58:23.513ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.323653ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
118542024-12-21T07:58:23.513ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
118552024-12-21T07:58:23.513ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.616978ms iteration = 13 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
118562024-12-21T07:58:23.516ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118572024-12-21T07:58:23.518ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.662444ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
118582024-12-21T07:58:23.518ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118592024-12-21T07:58:23.519ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 7.703172ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
118602024-12-21T07:58:23.520ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
118612024-12-21T07:58:23.520ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118622024-12-21T07:58:23.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118632024-12-21T07:58:23.522ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118642024-12-21T07:58:23.522ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
118652024-12-21T07:58:23.522ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118662024-12-21T07:58:23.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118672024-12-21T07:58:23.525ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
118682024-12-21T07:58:23.525ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118692024-12-21T07:58:23.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118702024-12-21T07:58:23.527ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
118712024-12-21T07:58:23.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
118722024-12-21T07:58:23.529ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1623, tv_nsec: 475596771 } })
118732024-12-21T07:58:23.529ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
118742024-12-21T07:58:23.529ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
118752024-12-21T07:58:23.529ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 17.680514ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
118762024-12-21T07:58:23.529ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
118772024-12-21T07:58:23.529ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118782024-12-21T07:58:23.530ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118792024-12-21T07:58:23.531ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1623, tv_nsec: 477869530 } })
118802024-12-21T07:58:23.531ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
118812024-12-21T07:58:23.532ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
118822024-12-21T07:58:23.532ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118832024-12-21T07:58:23.532ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
118842024-12-21T07:58:23.532ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
118852024-12-21T07:58:23.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118862024-12-21T07:58:23.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
118872024-12-21T07:58:23.533ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:48:23.511803952 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
118882024-12-21T07:58:23.533ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 21.950717ms iteration = 12 status = {"expiration":"2024-12-21T07:48:23.511803952Z","pruned":[]}
118892024-12-21T07:58:23.535ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118902024-12-21T07:58:23.536ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 24.353018ms iteration = 23 status = {"errors":[],"finish_invoked_ok":[]}
118912024-12-21T07:58:23.536ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118922024-12-21T07:58:23.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
118932024-12-21T07:58:23.537ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
118942024-12-21T07:58:23.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
118952024-12-21T07:58:23.537ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118962024-12-21T07:58:23.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
118972024-12-21T07:58:23.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
118982024-12-21T07:58:23.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
118992024-12-21T07:58:23.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
119002024-12-21T07:58:23.541ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
119012024-12-21T07:58:23.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
119022024-12-21T07:58:23.543ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119032024-12-21T07:58:23.546ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
119042024-12-21T07:58:23.546ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119052024-12-21T07:58:23.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119062024-12-21T07:58:23.548ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119072024-12-21T07:58:23.550ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1623, tv_nsec: 497058349 } })
119082024-12-21T07:58:23.550ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
119092024-12-21T07:58:23.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
119102024-12-21T07:58:23.552ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
119112024-12-21T07:58:23.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119122024-12-21T07:58:23.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
119132024-12-21T07:58:23.553ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
119142024-12-21T07:58:23.553ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
119152024-12-21T07:58:23.553ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
119162024-12-21T07:58:23.553ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
119172024-12-21T07:58:23.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119182024-12-21T07:58:23.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
119192024-12-21T07:58:23.553ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
119202024-12-21T07:58:23.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
119212024-12-21T07:58:23.554ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
119222024-12-21T07:58:23.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
119232024-12-21T07:58:23.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119242024-12-21T07:58:23.557ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119252024-12-21T07:58:23.557ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119262024-12-21T07:58:23.558ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119272024-12-21T07:58:23.562ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
119282024-12-21T07:58:23.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119292024-12-21T07:58:23.562ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
119302024-12-21T07:58:23.562ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
119312024-12-21T07:58:23.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119322024-12-21T07:58:23.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
119332024-12-21T07:58:23.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
119342024-12-21T07:58:23.563ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
119352024-12-21T07:58:23.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
119362024-12-21T07:58:23.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
119372024-12-21T07:58:23.564ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
119382024-12-21T07:58:23.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
119392024-12-21T07:58:23.570ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
119402024-12-21T07:58:23.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
119412024-12-21T07:58:23.578ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
119422024-12-21T07:58:23.578ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 0 version = 2
119432024-12-21T07:58:23.578ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
119442024-12-21T07:58:23.578ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 67.302534ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
119452024-12-21T07:58:23.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
119462024-12-21T07:58:23.581ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119472024-12-21T07:58:23.583ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
119482024-12-21T07:58:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
119492024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
119502024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
119512024-12-21T07:58:23.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
119522024-12-21T07:58:23.587ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 75.879712ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
119532024-12-21T07:58:23.588ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
119542024-12-21T07:58:23.588ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 76.418741ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
119552024-12-21T07:58:23.588ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 1 version = 2
119562024-12-21T07:58:23.588ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
119572024-12-21T07:58:23.588ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 07:47:25.290148 UTC dns_group = external generation = 2
119582024-12-21T07:58:23.589ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 77.213555ms iteration = 13 status = {"generation":2}
119592024-12-21T07:58:23.590ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119602024-12-21T07:58:23.591ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
119612024-12-21T07:58:23.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
119622024-12-21T07:58:23.592ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
119632024-12-21T07:58:23.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
119642024-12-21T07:58:23.593ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
119652024-12-21T07:58:23.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
119662024-12-21T07:58:23.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
119672024-12-21T07:58:23.597ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
119682024-12-21T07:58:23.597ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
119692024-12-21T07:58:23.597ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
119702024-12-21T07:58:23.597ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 86.172418ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
119712024-12-21T07:58:23.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
119722024-12-21T07:58:23.598ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
119732024-12-21T07:58:23.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
119742024-12-21T07:58:23.607ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 96.058387ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
119752024-12-21T07:58:23.611ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119762024-12-21T07:58:23.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
119772024-12-21T07:58:23.615ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
119782024-12-21T07:58:23.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
119792024-12-21T07:58:23.621ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 109.437127ms iteration = 23 status = 0
119802024-12-21T07:58:23.626ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
119812024-12-21T07:58:23.626ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
119822024-12-21T07:58:23.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
119832024-12-21T07:58:23.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
119842024-12-21T07:58:23.628ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
119852024-12-21T07:58:23.628ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 116.501278ms iteration = 26 status = {"physical_disks_added":0}
119862024-12-21T07:58:23.628ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 116.484607ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
119872024-12-21T07:58:23.629ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
119882024-12-21T07:58:23.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
119892024-12-21T07:58:23.636ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
119902024-12-21T07:58:23.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 125.579794ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
119912024-12-21T07:58:23.640ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119922024-12-21T07:58:23.643ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
119932024-12-21T07:58:23.643ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
119942024-12-21T07:58:23.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
119952024-12-21T07:58:23.647ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
119962024-12-21T07:58:23.647ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
119972024-12-21T07:58:23.647ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 135.185959ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
119982024-12-21T07:58:23.655ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
119992024-12-21T07:58:23.655ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
120002024-12-21T07:58:23.655ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
120012024-12-21T07:58:23.655ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
120022024-12-21T07:58:23.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
120032024-12-21T07:58:23.658ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120042024-12-21T07:58:23.658ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
120052024-12-21T07:58:23.659ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
120062024-12-21T07:58:23.659ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
120072024-12-21T07:58:23.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
120082024-12-21T07:58:23.660ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
120092024-12-21T07:58:23.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
120102024-12-21T07:58:23.663ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
120112024-12-21T07:58:23.663ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
120122024-12-21T07:58:23.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
120132024-12-21T07:58:23.674ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
120142024-12-21T07:58:23.678ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
120152024-12-21T07:58:23.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
120162024-12-21T07:58:23.685ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
120172024-12-21T07:58:23.685ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
120182024-12-21T07:58:23.685ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "41effc19-0301-4b7e-b683-76c1d62e81ab", "content-length": "26", "date": "Sat, 21 Dec 2024 07:58:23 GMT"} })
120192024-12-21T07:58:23.685ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
120202024-12-21T07:58:23.687ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
120212024-12-21T07:58:23.714ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:47:21.583817Z, time_modified: 2024-12-21T07:47:21.583817Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }) }
120222024-12-21T07:58:23.714ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 202.482743ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]}},"default_endpoint":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
120232024-12-21T07:58:23.727ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
120242024-12-21T07:58:23.727ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
120252024-12-21T07:58:23.728ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3a077eb-4688-497e-845d-b02c4502af39", "content-length": "26", "date": "Sat, 21 Dec 2024 07:58:23 GMT"} })
120262024-12-21T07:58:23.728ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
120272024-12-21T07:58:23.729ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
120282024-12-21T07:58:23.730ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
120292024-12-21T07:58:23.730ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
120302024-12-21T07:58:23.730ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b7c9936-e5fe-40e1-a519-fe37aac6c1e4", "content-length": "26", "date": "Sat, 21 Dec 2024 07:58:23 GMT"} })
120312024-12-21T07:58:23.730ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
120322024-12-21T07:58:23.734ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
120332024-12-21T07:58:23.895ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
120342024-12-21T07:58:23.895ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "e4ee112e-8d78-4791-9c53-7da2ab31097d", "date": "Sat, 21 Dec 2024 07:58:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
120352024-12-21T07:58:23.895ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
120362024-12-21T07:58:23.896ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "44c2f01f-cf3f-4b9d-a2a8-dc2895ab58da", "date": "Sat, 21 Dec 2024 07:58:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
120372024-12-21T07:58:23.897ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
120382024-12-21T07:58:23.898ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
120392024-12-21T07:58:23.898ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 386.52349ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
120402024-12-21T07:58:23.912ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
120412024-12-21T07:58:23.912ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ec0a394-f31c-4335-baf7-d72838c998f7", "content-length": "1", "date": "Sat, 21 Dec 2024 07:58:22 GMT"} })
120422024-12-21T07:58:23.914ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
120432024-12-21T07:58:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
120442024-12-21T07:58:23.928ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
120452024-12-21T07:58:23.950ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
120462024-12-21T07:58:23.950ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
120472024-12-21T07:58:23.950ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1491f885-8d72-42bf-960d-45e5c819ee63", "content-length": "372", "date": "Sat, 21 Dec 2024 07:58:23 GMT"} })
120482024-12-21T07:58:23.950ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
120492024-12-21T07:58:23.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120502024-12-21T07:58:23.953ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
120512024-12-21T07:58:23.953ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
120522024-12-21T07:58:23.953ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 441.624964ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
120532024-12-21T07:58:23.953ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
120542024-12-21T07:58:23.954ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
120552024-12-21T07:58:23.954ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
120562024-12-21T07:58:23.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
120572024-12-21T07:58:23.954ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120582024-12-21T07:58:23.954ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 443.15605ms iteration = 23 status = null
120592024-12-21T07:58:23.955ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120602024-12-21T07:58:23.956ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
120612024-12-21T07:58:23.956ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
120622024-12-21T07:58:23.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
120632024-12-21T07:58:23.958ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120642024-12-21T07:58:23.959ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
120652024-12-21T07:58:23.959ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
120662024-12-21T07:58:23.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
120672024-12-21T07:58:23.960ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
120682024-12-21T07:58:23.960ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
120692024-12-21T07:58:23.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
120702024-12-21T07:58:23.962ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
120712024-12-21T07:58:23.962ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
120722024-12-21T07:58:23.962ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 07:47:23.936594 UTC dns_group = internal generation = 1
120732024-12-21T07:58:23.962ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 451.376282ms iteration = 13 status = {"generation":1}
120742024-12-21T07:58:23.968ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
120752024-12-21T07:58:23.968ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
120762024-12-21T07:58:23.997ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 485.882404ms iteration = 23 status = {}
120772024-12-21T07:58:24.015ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
120782024-12-21T07:58:24.016ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "fecf7110-24a4-41ea-aebe-071c0fa69336", "date": "Sat, 21 Dec 2024 07:58:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
120792024-12-21T07:58:24.016ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
120802024-12-21T07:58:24.017ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "9e510543-3b36-47ce-9364-f292a0c7dd19", "date": "Sat, 21 Dec 2024 07:58:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
120812024-12-21T07:58:24.017ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
120822024-12-21T07:58:24.019ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a6525b1f-91d0-492a-9b6a-f32094325ce6", "date": "Sat, 21 Dec 2024 07:58:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
120832024-12-21T07:58:24.019ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
120842024-12-21T07:58:24.020ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
120852024-12-21T07:58:24.020ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 509.216014ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
120862024-12-21T07:58:24.050ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
120872024-12-21T07:58:24.050ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 538.13016ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
120882024-12-21T07:58:24.071ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0227ac0d-3ced-44e1-9609-ef7ab7c99506", "date": "Sat, 21 Dec 2024 07:58:24 GMT"} })
120892024-12-21T07:58:24.072ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
120902024-12-21T07:58:24.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120912024-12-21T07:58:24.075ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
120922024-12-21T07:58:24.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120932024-12-21T07:58:24.078ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
120942024-12-21T07:58:24.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120952024-12-21T07:58:24.081ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
120962024-12-21T07:58:24.081ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
120972024-12-21T07:58:24.082ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a15ba03a-3501-4f9f-a441-0986506bd306", "date": "Sat, 21 Dec 2024 07:58:23 GMT"} })
120982024-12-21T07:58:24.083ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 572.179674ms iteration = 24 status = {}
120992024-12-21T07:58:24.095ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121002024-12-21T07:58:24.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121012024-12-21T07:58:24.096ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
121022024-12-21T07:58:24.096ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "53f8f4a6-694b-4d2f-ab6c-b221f66c288f", "content-length": "691", "date": "Sat, 21 Dec 2024 07:58:23 GMT"} })
121032024-12-21T07:58:24.096ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
121042024-12-21T07:58:24.096ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
121052024-12-21T07:58:24.096ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
121062024-12-21T07:58:24.097ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
121072024-12-21T07:58:24.097ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121082024-12-21T07:58:24.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121092024-12-21T07:58:24.098ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 587.158971ms iteration = 23 status = {}
121102024-12-21T07:58:24.107ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
121112024-12-21T07:58:24.107ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b48506f2-a69c-4fd3-85b0-0219b85e2646", "content-length": "134", "date": "Sat, 21 Dec 2024 07:58:24 GMT"} })
121122024-12-21T07:58:24.107ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
121132024-12-21T07:58:24.107ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
121142024-12-21T07:58:24.108ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
121152024-12-21T07:58:24.108ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
121162024-12-21T07:58:24.108ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
121172024-12-21T07:58:24.108ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
121182024-12-21T07:58:24.108ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
121192024-12-21T07:58:24.108ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
121202024-12-21T07:58:24.108ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
121212024-12-21T07:58:24.108ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
121222024-12-21T07:58:24.108ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
121232024-12-21T07:58:24.108ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121242024-12-21T07:58:24.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121252024-12-21T07:58:24.111ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
121262024-12-21T07:58:24.111ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "232103b4-10fd-4209-b128-737d305f5800", "content-length": "2", "date": "Sat, 21 Dec 2024 07:58:24 GMT"} })
121272024-12-21T07:58:24.111ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
121282024-12-21T07:58:24.111ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "73adc613-afc4-41de-928e-3200ac6b7b4b", "content-length": "52", "date": "Sat, 21 Dec 2024 07:58:24 GMT"} })
121292024-12-21T07:58:24.111ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
121302024-12-21T07:58:24.111ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
121312024-12-21T07:58:24.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 06cfb584-cc40-40d5-a1fc-767deed8dea2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
121322024-12-21T07:58:24.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 06cfb584-cc40-40d5-a1fc-767deed8dea2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
121332024-12-21T07:58:24.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2348 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 06cfb584-cc40-40d5-a1fc-767deed8dea2 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
121342024-12-21T07:58:24.203ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "618e6621-eaa3-4ef7-92b0-2498b92fd740", "date": "Sat, 21 Dec 2024 07:58:23 GMT"} })
121352024-12-21T07:58:24.203ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
121362024-12-21T07:58:24.203ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
121372024-12-21T07:58:24.203ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "687124b1-e017-47c6-b65e-557ed6eb3baf", "content-length": "682", "date": "Sat, 21 Dec 2024 07:58:24 GMT"} })
121382024-12-21T07:58:24.203ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121392024-12-21T07:58:24.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121402024-12-21T07:58:24.207ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121412024-12-21T07:58:24.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121422024-12-21T07:58:24.209ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121432024-12-21T07:58:24.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121442024-12-21T07:58:24.211ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121452024-12-21T07:58:24.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121462024-12-21T07:58:24.219ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 707.82181ms iteration = 23 status = {}
121472024-12-21T07:58:25.902ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1260 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 77fcd3e5-018e-48bf-b26e-2f736c23ea5f response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
121482024-12-21T07:58:33.511ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
121492024-12-21T07:58:33.511ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
121502024-12-21T07:58:33.511ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121512024-12-21T07:58:33.511ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
121522024-12-21T07:58:33.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121532024-12-21T07:58:33.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
121542024-12-21T07:58:33.513ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121552024-12-21T07:58:33.513ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
121562024-12-21T07:58:33.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
121572024-12-21T07:58:33.515ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.873486ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
121582024-12-21T07:58:33.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
121592024-12-21T07:58:33.516ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121602024-12-21T07:58:33.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121612024-12-21T07:58:33.517ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121622024-12-21T07:58:33.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121632024-12-21T07:58:33.519ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121642024-12-21T07:58:33.522ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
121652024-12-21T07:58:33.522ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121662024-12-21T07:58:33.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121672024-12-21T07:58:33.530ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
121682024-12-21T07:58:33.530ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.087878ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
121692024-12-21T07:58:35.901ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1225 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = cb9353b9-7751-4bf6-b314-8a86bb616d33 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
121702024-12-21T07:58:43.512ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
121712024-12-21T07:58:43.512ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
121722024-12-21T07:58:43.512ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
121732024-12-21T07:58:43.512ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121742024-12-21T07:58:43.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
121752024-12-21T07:58:43.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121762024-12-21T07:58:43.514ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
121772024-12-21T07:58:43.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
121782024-12-21T07:58:43.515ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121792024-12-21T07:58:43.516ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.06733ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
121802024-12-21T07:58:43.517ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
121812024-12-21T07:58:43.517ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121822024-12-21T07:58:43.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121832024-12-21T07:58:43.519ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121842024-12-21T07:58:43.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121852024-12-21T07:58:43.521ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121862024-12-21T07:58:43.523ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
121872024-12-21T07:58:43.523ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121882024-12-21T07:58:43.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121892024-12-21T07:58:43.532ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
121902024-12-21T07:58:43.532ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.45335ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
121912024-12-21T07:58:45.902ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1210 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 1ed360fb-4b6c-4bed-9e05-76bdad4c64db response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
121922024-12-21T07:58:46.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 4ef218eb-5d0a-4989-bd69-500c603f8fe2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
121932024-12-21T07:58:46.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 4ef218eb-5d0a-4989-bd69-500c603f8fe2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
121942024-12-21T07:58:46.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6386 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 4ef218eb-5d0a-4989-bd69-500c603f8fe2 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
121952024-12-21T07:58:46.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 0c7bb592-392e-4a84-9d30-29483b828c35 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/9?limit=100
121962024-12-21T07:58:46.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 0c7bb592-392e-4a84-9d30-29483b828c35 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/9?limit=100
121972024-12-21T07:58:46.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4721 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 0c7bb592-392e-4a84-9d30-29483b828c35 response_code = 200 uri = /nat/ipv4/changeset/9?limit=100
121982024-12-21T07:58:52.958ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1:0]:62990
121992024-12-21T07:58:52.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:62990 req_id = b116d392-b03f-48a2-a4e6-6d2b5ab0f622 roles = RoleSet { roles: {} } uri = /metrics/producers
122002024-12-21T07:58:52.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:62990 req_id = b116d392-b03f-48a2-a4e6-6d2b5ab0f622 resource = Database result = Ok(()) uri = /metrics/producers
122012024-12-21T07:58:52.968ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b
122022024-12-21T07:58:52.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9903 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:62990 req_id = b116d392-b03f-48a2-a4e6-6d2b5ab0f622 response_code = 201 uri = /metrics/producers
122032024-12-21T07:58:53.511ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
122042024-12-21T07:58:53.511ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
122052024-12-21T07:58:53.511ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
122062024-12-21T07:58:53.511ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
122072024-12-21T07:58:53.511ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
122082024-12-21T07:58:53.511ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
122092024-12-21T07:58:53.511ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
122102024-12-21T07:58:53.511ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
122112024-12-21T07:58:53.511ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
122122024-12-21T07:58:53.511ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
122132024-12-21T07:58:53.511ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
122142024-12-21T07:58:53.511ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
122152024-12-21T07:58:53.511ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
122162024-12-21T07:58:53.511ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
122172024-12-21T07:58:53.511ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
122182024-12-21T07:58:53.511ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
122192024-12-21T07:58:53.511ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
122202024-12-21T07:58:53.511ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
122212024-12-21T07:58:53.511ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
122222024-12-21T07:58:53.511ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
122232024-12-21T07:58:53.511ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122242024-12-21T07:58:53.511ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
122252024-12-21T07:58:53.511ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
122262024-12-21T07:58:53.511ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
122272024-12-21T07:58:53.511ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122282024-12-21T07:58:53.511ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
122292024-12-21T07:58:53.511ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
122302024-12-21T07:58:53.511ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
122312024-12-21T07:58:53.511ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
122322024-12-21T07:58:53.511ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
122332024-12-21T07:58:53.511ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
122342024-12-21T07:58:53.511ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
122352024-12-21T07:58:53.511ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122362024-12-21T07:58:53.511ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
122372024-12-21T07:58:53.511ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
122382024-12-21T07:58:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
122392024-12-21T07:58:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
122402024-12-21T07:58:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
122412024-12-21T07:58:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
122422024-12-21T07:58:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
122432024-12-21T07:58:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
122442024-12-21T07:58:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
122452024-12-21T07:58:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
122462024-12-21T07:58:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
122472024-12-21T07:58:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122482024-12-21T07:58:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122492024-12-21T07:58:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
122502024-12-21T07:58:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
122512024-12-21T07:58:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
122522024-12-21T07:58:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
122532024-12-21T07:58:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122542024-12-21T07:58:53.515ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.168161ms iteration = 24 status = {"errors":[],"finish_invoked_ok":[]}
122552024-12-21T07:58:53.515ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.187052ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
122562024-12-21T07:58:53.516ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122572024-12-21T07:58:53.516ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122582024-12-21T07:58:53.519ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
122592024-12-21T07:58:53.519ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
122602024-12-21T07:58:53.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
122612024-12-21T07:58:53.521ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
122622024-12-21T07:58:53.521ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
122632024-12-21T07:58:53.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
122642024-12-21T07:58:53.522ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122652024-12-21T07:58:53.523ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1653, tv_nsec: 470097876 } })
122662024-12-21T07:58:53.524ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1653, tv_nsec: 470270619 } })
122672024-12-21T07:58:53.524ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
122682024-12-21T07:58:53.524ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
122692024-12-21T07:58:53.524ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122702024-12-21T07:58:53.524ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
122712024-12-21T07:58:53.524ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
122722024-12-21T07:58:53.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
122732024-12-21T07:58:53.525ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
122742024-12-21T07:58:53.526ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122752024-12-21T07:58:53.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
122762024-12-21T07:58:53.527ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122772024-12-21T07:58:53.527ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
122782024-12-21T07:58:53.527ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122792024-12-21T07:58:53.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122802024-12-21T07:58:53.528ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
122812024-12-21T07:58:53.528ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122822024-12-21T07:58:53.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122832024-12-21T07:58:53.530ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
122842024-12-21T07:58:53.530ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
122852024-12-21T07:58:53.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
122862024-12-21T07:58:53.531ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1653, tv_nsec: 477314110 } })
122872024-12-21T07:58:53.531ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
122882024-12-21T07:58:53.531ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
122892024-12-21T07:58:53.531ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
122902024-12-21T07:58:53.531ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
122912024-12-21T07:58:53.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
122922024-12-21T07:58:53.532ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
122932024-12-21T07:58:53.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
122942024-12-21T07:58:53.533ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
122952024-12-21T07:58:53.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
122962024-12-21T07:58:53.533ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 21.840645ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
122972024-12-21T07:58:53.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122982024-12-21T07:58:53.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122992024-12-21T07:58:53.533ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123002024-12-21T07:58:53.535ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
123012024-12-21T07:58:53.535ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123022024-12-21T07:58:53.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123032024-12-21T07:58:53.536ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
123042024-12-21T07:58:53.536ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
123052024-12-21T07:58:53.536ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
123062024-12-21T07:58:53.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
123072024-12-21T07:58:53.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123082024-12-21T07:58:53.540ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123092024-12-21T07:58:53.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
123102024-12-21T07:58:53.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123112024-12-21T07:58:53.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123122024-12-21T07:58:53.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
123132024-12-21T07:58:53.544ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
123142024-12-21T07:58:53.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
123152024-12-21T07:58:53.549ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
123162024-12-21T07:58:53.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
123172024-12-21T07:58:53.560ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
123182024-12-21T07:58:53.560ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 48.897949ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
123192024-12-21T07:58:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
123202024-12-21T07:58:53.561ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
123212024-12-21T07:58:53.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
123222024-12-21T07:58:53.561ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
123232024-12-21T07:58:53.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123242024-12-21T07:58:53.571ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
123252024-12-21T07:58:53.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
123262024-12-21T07:58:53.576ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
123272024-12-21T07:58:53.576ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
123282024-12-21T07:58:53.576ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 65.058896ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
123292024-12-21T07:58:53.648ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
123302024-12-21T07:58:53.648ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
123312024-12-21T07:58:53.648ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c6ba13d-8327-4c63-857c-9165aaa81368", "content-length": "26", "date": "Sat, 21 Dec 2024 07:58:53 GMT"} })
123322024-12-21T07:58:53.648ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
123332024-12-21T07:58:53.650ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
123342024-12-21T07:58:53.655ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
123352024-12-21T07:58:53.655ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
123362024-12-21T07:58:53.655ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "175ac075-79d3-4629-9bd0-d8d98b66bbb0", "content-length": "26", "date": "Sat, 21 Dec 2024 07:58:53 GMT"} })
123372024-12-21T07:58:53.655ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
123382024-12-21T07:58:53.657ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
123392024-12-21T07:58:53.677ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
123402024-12-21T07:58:53.678ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
123412024-12-21T07:58:53.678ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7ec82b3-02af-4eee-a272-546e74795e46", "content-length": "26", "date": "Sat, 21 Dec 2024 07:58:53 GMT"} })
123422024-12-21T07:58:53.678ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
123432024-12-21T07:58:53.680ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
123442024-12-21T07:58:53.698ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f/state
123452024-12-21T07:58:53.699ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/035b4828-aaf9-4ffa-b53c-96c2c815880f/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "8956475b-0bfd-42ce-944f-5a6b0ddcf2d2", "content-length": "130", "date": "Sat, 21 Dec 2024 07:58:52 GMT"} })
123462024-12-21T07:58:53.699ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-21T07:58:52.980427333Z }, migration_in: None, migration_out: None } vmm_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f
123472024-12-21T07:58:53.699ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2077 instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e vmm_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-21T07:58:52.980427333Z }
123482024-12-21T07:58:53.699ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b roles = RoleSet { roles: {} } sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e vmm_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f
123492024-12-21T07:58:53.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 6f7deba6-bca8-40a5-a059-99eca3610b4b resource = Database result = Ok(()) sled_id = c992e3dc-2d80-4655-85d0-78e9a80bf69e vmm_id = 035b4828-aaf9-4ffa-b53c-96c2c815880f
123502024-12-21T07:58:53.702ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
123512024-12-21T07:58:53.702ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
123522024-12-21T07:58:53.703ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b371541b-5abd-43c9-9d0a-36ac608d25fb", "content-length": "583", "date": "Sat, 21 Dec 2024 07:58:53 GMT"} })
123532024-12-21T07:58:53.703ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123542024-12-21T07:58:53.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123552024-12-21T07:58:53.705ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
123562024-12-21T07:58:53.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123572024-12-21T07:58:53.706ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
123582024-12-21T07:58:53.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
123592024-12-21T07:58:53.713ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
123602024-12-21T07:58:53.713ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 201.394844ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
123612024-12-21T07:58:53.737ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 226.057737ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
123622024-12-21T07:58:53.753ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
123632024-12-21T07:58:53.753ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 242.230155ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
123642024-12-21T07:58:53.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
123652024-12-21T07:58:53.757ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123662024-12-21T07:58:53.760ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
123672024-12-21T07:58:53.760ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
123682024-12-21T07:58:53.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
123692024-12-21T07:58:53.762ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123702024-12-21T07:58:53.762ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
123712024-12-21T07:58:53.764ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123722024-12-21T07:58:53.764ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 252.623503ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
123732024-12-21T07:58:53.764ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
123742024-12-21T07:58:53.764ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
123752024-12-21T07:58:53.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
123762024-12-21T07:58:53.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
123772024-12-21T07:58:53.768ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
123782024-12-21T07:58:53.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123792024-12-21T07:58:53.769ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
123802024-12-21T07:58:53.769ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc335736-7531-43d8-b33d-76e7fd567bad", "content-length": "1", "date": "Sat, 21 Dec 2024 07:58:53 GMT"} })
123812024-12-21T07:58:53.770ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 259.219596ms iteration = 24 status = 0
123822024-12-21T07:58:53.771ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
123832024-12-21T07:58:53.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
123842024-12-21T07:58:53.775ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {169256bd-a993-4243-8a33-d9a8a0e7f510: {10.151.1.176: {bd82cf95-0482-4aa2-a1a0-5bafb78de2df}, 10.151.1.175: {bd82cf95-0482-4aa2-a1a0-5bafb78de2df}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
123852024-12-21T07:58:53.775ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
123862024-12-21T07:58:53.776ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e2a41c47-444b-4fc9-b2db-f25fefa82fa4", "date": "Sat, 21 Dec 2024 07:58:53 GMT"} })
123872024-12-21T07:58:53.776ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123882024-12-21T07:58:53.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123892024-12-21T07:58:53.785ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 274.098092ms iteration = 24 status = {}
123902024-12-21T07:58:53.788ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 276.648055ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
123912024-12-21T07:58:53.826ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 314.958652ms iteration = 27 status = {"physical_disks_added":0}
123922024-12-21T07:58:53.836ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
123932024-12-21T07:58:53.836ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5277c230-c219-4248-ba70-9bc9bc1d2f16", "content-length": "810", "date": "Sat, 21 Dec 2024 07:58:52 GMT"} })
123942024-12-21T07:58:53.836ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(7358898) }} sled = buskin
123952024-12-21T07:58:53.836ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
123962024-12-21T07:58:53.836ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
123972024-12-21T07:58:53.838ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 326.273096ms iteration = 24 status = {}
123982024-12-21T07:58:53.838ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 326.855016ms iteration = 24 status = null
123992024-12-21T07:58:53.839ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124002024-12-21T07:58:53.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124012024-12-21T07:58:53.842ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124022024-12-21T07:58:53.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124032024-12-21T07:58:53.845ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124042024-12-21T07:58:53.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124052024-12-21T07:58:53.847ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124062024-12-21T07:58:53.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124072024-12-21T07:58:53.850ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124082024-12-21T07:58:53.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124092024-12-21T07:58:53.853ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
124102024-12-21T07:58:53.853ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
124112024-12-21T07:58:53.853ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
124122024-12-21T07:58:53.854ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "dc1fdccb-772b-4a83-9b07-c3e46b57c9a6", "date": "Sat, 21 Dec 2024 07:58:52 GMT"} })
124132024-12-21T07:58:53.856ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 344.866125ms iteration = 25 status = {}
124142024-12-21T07:58:53.869ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124152024-12-21T07:58:53.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124162024-12-21T07:58:53.872ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
124172024-12-21T07:58:53.872ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124182024-12-21T07:58:53.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124192024-12-21T07:58:53.885ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
124202024-12-21T07:58:53.885ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "95199ae4-8003-4c11-b199-b9270e62e891", "content-length": "134", "date": "Sat, 21 Dec 2024 07:58:53 GMT"} })
124212024-12-21T07:58:53.885ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
124222024-12-21T07:58:53.885ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
124232024-12-21T07:58:53.885ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
124242024-12-21T07:58:53.885ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
124252024-12-21T07:58:53.885ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
124262024-12-21T07:58:53.885ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
124272024-12-21T07:58:53.885ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
124282024-12-21T07:58:53.885ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
124292024-12-21T07:58:53.886ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
124302024-12-21T07:58:53.886ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
124312024-12-21T07:58:53.886ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
124322024-12-21T07:58:53.886ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124332024-12-21T07:58:53.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124342024-12-21T07:58:53.889ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
124352024-12-21T07:58:53.889ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d640989-bf3a-4c05-9607-4bcb81ed1a06", "content-length": "2", "date": "Sat, 21 Dec 2024 07:58:53 GMT"} })
124362024-12-21T07:58:53.889ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
124372024-12-21T07:58:53.889ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a917315-6adc-4220-8350-3f2b32570a03", "content-length": "52", "date": "Sat, 21 Dec 2024 07:58:53 GMT"} })
124382024-12-21T07:58:53.889ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
124392024-12-21T07:58:53.889ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
124402024-12-21T07:58:53.994ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7e38caf1-2ce2-411d-974a-67ed24f1c444", "date": "Sat, 21 Dec 2024 07:58:53 GMT"} })
124412024-12-21T07:58:53.994ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
124422024-12-21T07:58:53.994ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
124432024-12-21T07:58:53.995ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee10e8b5-a4e5-4774-940e-265f1fdeb733", "content-length": "682", "date": "Sat, 21 Dec 2024 07:58:53 GMT"} })
124442024-12-21T07:58:53.995ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124452024-12-21T07:58:53.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124462024-12-21T07:58:53.999ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124472024-12-21T07:58:53.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124482024-12-21T07:58:54.003ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124492024-12-21T07:58:54.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124502024-12-21T07:58:54.006ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124512024-12-21T07:58:54.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124522024-12-21T07:58:54.013ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 502.290534ms iteration = 24 status = {}
124532024-12-21T07:58:55.902ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1445 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 68177fbb-c4f5-42a0-8c3b-be4a54be2880 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
124542024-12-21T07:59:03.511ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
124552024-12-21T07:59:03.511ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
124562024-12-21T07:59:03.511ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124572024-12-21T07:59:03.511ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
124582024-12-21T07:59:03.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124592024-12-21T07:59:03.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
124602024-12-21T07:59:03.513ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124612024-12-21T07:59:03.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
124622024-12-21T07:59:03.516ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124632024-12-21T07:59:03.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124642024-12-21T07:59:03.517ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124652024-12-21T07:59:03.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124662024-12-21T07:59:03.519ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124672024-12-21T07:59:03.521ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
124682024-12-21T07:59:03.521ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124692024-12-21T07:59:03.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124702024-12-21T07:59:03.533ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
124712024-12-21T07:59:03.533ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.534406ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
124722024-12-21T07:59:03.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
124732024-12-21T07:59:03.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
124742024-12-21T07:59:03.543ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.124931ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
124752024-12-21T07:59:04.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 51fc4a03-3636-452d-9a9d-2d0441ae813b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/9?limit=100
124762024-12-21T07:59:04.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 51fc4a03-3636-452d-9a9d-2d0441ae813b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/9?limit=100
124772024-12-21T07:59:04.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2881 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 51fc4a03-3636-452d-9a9d-2d0441ae813b response_code = 200 uri = /nat/ipv4/changeset/9?limit=100
124782024-12-21T07:59:04.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = d74f7312-cf9b-40a6-b470-0326ed10a693 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
124792024-12-21T07:59:04.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = d74f7312-cf9b-40a6-b470-0326ed10a693 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
124802024-12-21T07:59:04.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3966 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = d74f7312-cf9b-40a6-b470-0326ed10a693 response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
124812024-12-21T07:59:05.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = eb454c67-f367-474a-b1b0-5533b1b6f95c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
124822024-12-21T07:59:05.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = eb454c67-f367-474a-b1b0-5533b1b6f95c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
124832024-12-21T07:59:05.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3592 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = eb454c67-f367-474a-b1b0-5533b1b6f95c response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
124842024-12-21T07:59:05.831ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:54263
124852024-12-21T07:59:05.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54263 req_id = cb52e296-96cc-447a-b247-d5f70c4918c1 roles = RoleSet { roles: {} } uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
124862024-12-21T07:59:05.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54263 req_id = cb52e296-96cc-447a-b247-d5f70c4918c1 resource = Database result = Ok(()) uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
124872024-12-21T07:59:05.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2143 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54263 req_id = cb52e296-96cc-447a-b247-d5f70c4918c1 response_code = 200 uri = /probes/c992e3dc-2d80-4655-85d0-78e9a80bf69e
124882024-12-21T07:59:05.902ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1280 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 9de8f3ad-91b8-4436-ba15-f6f3436d2c52 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
124892024-12-21T07:59:06.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 09d590a3-1cf0-4a49-b2e2-e27358a2ada3 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
124902024-12-21T07:59:06.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 09d590a3-1cf0-4a49-b2e2-e27358a2ada3 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
124912024-12-21T07:59:06.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3195 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 09d590a3-1cf0-4a49-b2e2-e27358a2ada3 response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
124922024-12-21T07:59:07.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = af63d874-bfb1-41b4-8a2e-cb5c9e4c8f50 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
124932024-12-21T07:59:07.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = af63d874-bfb1-41b4-8a2e-cb5c9e4c8f50 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
124942024-12-21T07:59:07.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2528 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = af63d874-bfb1-41b4-8a2e-cb5c9e4c8f50 response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
124952024-12-21T07:59:08.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = e28a2e6b-c535-4d5e-b86b-6eb057fb995c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
124962024-12-21T07:59:08.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = e28a2e6b-c535-4d5e-b86b-6eb057fb995c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
124972024-12-21T07:59:08.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3200 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = e28a2e6b-c535-4d5e-b86b-6eb057fb995c response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
124982024-12-21T07:59:13.512ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
124992024-12-21T07:59:13.512ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
125002024-12-21T07:59:13.512ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
125012024-12-21T07:59:13.512ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125022024-12-21T07:59:13.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
125032024-12-21T07:59:13.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125042024-12-21T07:59:13.515ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
125052024-12-21T07:59:13.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
125062024-12-21T07:59:13.515ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125072024-12-21T07:59:13.517ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.63625ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
125082024-12-21T07:59:13.518ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
125092024-12-21T07:59:13.518ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125102024-12-21T07:59:13.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125112024-12-21T07:59:13.520ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125122024-12-21T07:59:13.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125132024-12-21T07:59:13.522ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125142024-12-21T07:59:13.524ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
125152024-12-21T07:59:13.524ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125162024-12-21T07:59:13.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125172024-12-21T07:59:13.535ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
125182024-12-21T07:59:13.535ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.149587ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
125192024-12-21T07:59:15.902ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1280 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 8821b092-ea94-41e9-bb07-fa1ac1ad6a79 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
125202024-12-21T07:59:20.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 4101d1d6-4764-49ca-bca5-c33dd6e36521 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
125212024-12-21T07:59:20.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 4101d1d6-4764-49ca-bca5-c33dd6e36521 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
125222024-12-21T07:59:20.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3709 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 4101d1d6-4764-49ca-bca5-c33dd6e36521 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
125232024-12-21T07:59:20.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 6d235159-621a-4f60-aae0-c2061c5b978c roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
125242024-12-21T07:59:20.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 6d235159-621a-4f60-aae0-c2061c5b978c resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
125252024-12-21T07:59:20.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2636 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 6d235159-621a-4f60-aae0-c2061c5b978c response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
125262024-12-21T07:59:23.511ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
125272024-12-21T07:59:23.511ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
125282024-12-21T07:59:23.511ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
125292024-12-21T07:59:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
125302024-12-21T07:59:23.511ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
125312024-12-21T07:59:23.511ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
125322024-12-21T07:59:23.511ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
125332024-12-21T07:59:23.511ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
125342024-12-21T07:59:23.511ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
125352024-12-21T07:59:23.511ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
125362024-12-21T07:59:23.511ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:49:23.511698110 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
125372024-12-21T07:59:23.511ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
125382024-12-21T07:59:23.511ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
125392024-12-21T07:59:23.511ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
125402024-12-21T07:59:23.511ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
125412024-12-21T07:59:23.511ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
125422024-12-21T07:59:23.511ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
125432024-12-21T07:59:23.511ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
125442024-12-21T07:59:23.511ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
125452024-12-21T07:59:23.511ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
125462024-12-21T07:59:23.511ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
125472024-12-21T07:59:23.511ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
125482024-12-21T07:59:23.511ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
125492024-12-21T07:59:23.511ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
125502024-12-21T07:59:23.511ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
125512024-12-21T07:59:23.511ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
125522024-12-21T07:59:23.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
125532024-12-21T07:59:23.511ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
125542024-12-21T07:59:23.511ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
125552024-12-21T07:59:23.511ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
125562024-12-21T07:59:23.511ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
125572024-12-21T07:59:23.511ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
125582024-12-21T07:59:23.511ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
125592024-12-21T07:59:23.511ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
125602024-12-21T07:59:23.511ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
125612024-12-21T07:59:23.511ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
125622024-12-21T07:59:23.511ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
125632024-12-21T07:59:23.511ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
125642024-12-21T07:59:23.511ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
125652024-12-21T07:59:23.511ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
125662024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
125672024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
125682024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
125692024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
125702024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
125712024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
125722024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
125732024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
125742024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
125752024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
125762024-12-21T07:59:23.512ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 3f45718f-9869-448a-a087-788e66db5e9d
125772024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.92\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"3f45718f-9869-448a-a087-788e66db5e9d"}
125782024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
125792024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
125802024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
125812024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
125822024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
125832024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
125842024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
125852024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125862024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
125872024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
125882024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
125892024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
125902024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
125912024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
125922024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
125932024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
125942024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
125952024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
125962024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
125972024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
125982024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
125992024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
126002024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
126012024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126022024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
126032024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
126042024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
126052024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
126062024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
126072024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126082024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
126092024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
126102024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
126112024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
126122024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126132024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
126142024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
126152024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
126162024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
126172024-12-21T07:59:23.512ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
126182024-12-21T07:59:23.513ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("481de7e8-0737-474b-8c33-e6e8bc6477be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("683a9892-43cd-4dd8-a983-26cccd988df0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8f03505f-bf62-49dd-8281-80933bc24548.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1683, tv_nsec: 458891384 } })
126192024-12-21T07:59:23.513ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1595c632-cfae-4f6b-937d-d413dd8cf0b7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e6b54c38-8771-4091-8fc3-2bbdae94bd35.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1683, tv_nsec: 458900494 } })
126202024-12-21T07:59:23.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
126212024-12-21T07:59:23.513ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
126222024-12-21T07:59:23.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
126232024-12-21T07:59:23.513ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
126242024-12-21T07:59:23.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
126252024-12-21T07:59:23.513ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
126262024-12-21T07:59:23.513ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.72976ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
126272024-12-21T07:59:23.513ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
126282024-12-21T07:59:23.513ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.354583ms iteration = 14 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
126292024-12-21T07:59:23.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
126302024-12-21T07:59:23.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
126312024-12-21T07:59:23.517ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1683, tv_nsec: 463665676 } })
126322024-12-21T07:59:23.517ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126332024-12-21T07:59:23.518ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
126342024-12-21T07:59:23.520ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:49:23.511698110 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
126352024-12-21T07:59:23.520ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.845861ms iteration = 13 status = {"expiration":"2024-12-21T07:49:23.511698110Z","pruned":[]}
126362024-12-21T07:59:23.521ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
126372024-12-21T07:59:23.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
126382024-12-21T07:59:23.521ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
126392024-12-21T07:59:23.521ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
126402024-12-21T07:59:23.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
126412024-12-21T07:59:23.523ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
126422024-12-21T07:59:23.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
126432024-12-21T07:59:23.526ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126442024-12-21T07:59:23.527ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 14.752043ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
126452024-12-21T07:59:23.529ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
126462024-12-21T07:59:23.529ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126472024-12-21T07:59:23.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126482024-12-21T07:59:23.533ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126492024-12-21T07:59:23.535ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 22.834562ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
126502024-12-21T07:59:23.536ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
126512024-12-21T07:59:23.536ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
126522024-12-21T07:59:23.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
126532024-12-21T07:59:23.546ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126542024-12-21T07:59:23.546ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126552024-12-21T07:59:23.548ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126562024-12-21T07:59:23.548ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
126572024-12-21T07:59:23.548ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
126582024-12-21T07:59:23.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
126592024-12-21T07:59:23.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
126602024-12-21T07:59:23.552ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
126612024-12-21T07:59:23.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
126622024-12-21T07:59:23.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
126632024-12-21T07:59:23.560ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126642024-12-21T07:59:23.560ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
126652024-12-21T07:59:23.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
126662024-12-21T07:59:23.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
126672024-12-21T07:59:23.565ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
126682024-12-21T07:59:23.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
126692024-12-21T07:59:23.573ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1683, tv_nsec: 518947584 } })
126702024-12-21T07:59:23.573ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
126712024-12-21T07:59:23.575ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126722024-12-21T07:59:23.577ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 65.619876ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
126732024-12-21T07:59:23.578ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
126742024-12-21T07:59:23.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
126752024-12-21T07:59:23.579ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126762024-12-21T07:59:23.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
126772024-12-21T07:59:23.579ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
126782024-12-21T07:59:23.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
126792024-12-21T07:59:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
126802024-12-21T07:59:23.587ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 76.017664ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
126812024-12-21T07:59:23.589ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126822024-12-21T07:59:23.591ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
126832024-12-21T07:59:23.591ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
126842024-12-21T07:59:23.591ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
126852024-12-21T07:59:23.592ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126862024-12-21T07:59:23.592ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
126872024-12-21T07:59:23.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
126882024-12-21T07:59:23.592ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126892024-12-21T07:59:23.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
126902024-12-21T07:59:23.593ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
126912024-12-21T07:59:23.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
126922024-12-21T07:59:23.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
126932024-12-21T07:59:23.594ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
126942024-12-21T07:59:23.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
126952024-12-21T07:59:23.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
126962024-12-21T07:59:23.596ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
126972024-12-21T07:59:23.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
126982024-12-21T07:59:23.597ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
126992024-12-21T07:59:23.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127002024-12-21T07:59:23.597ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127012024-12-21T07:59:23.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127022024-12-21T07:59:23.597ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127032024-12-21T07:59:23.598ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
127042024-12-21T07:59:23.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
127052024-12-21T07:59:23.599ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
127062024-12-21T07:59:23.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
127072024-12-21T07:59:23.600ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
127082024-12-21T07:59:23.600ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
127092024-12-21T07:59:23.600ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 88.071301ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
127102024-12-21T07:59:23.600ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
127112024-12-21T07:59:23.600ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
127122024-12-21T07:59:23.600ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
127132024-12-21T07:59:23.600ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
127142024-12-21T07:59:23.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
127152024-12-21T07:59:23.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
127162024-12-21T07:59:23.601ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127172024-12-21T07:59:23.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127182024-12-21T07:59:23.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127192024-12-21T07:59:23.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
127202024-12-21T07:59:23.605ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
127212024-12-21T07:59:23.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
127222024-12-21T07:59:23.606ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127232024-12-21T07:59:23.608ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1683, tv_nsec: 554719318 } })
127242024-12-21T07:59:23.609ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
127252024-12-21T07:59:23.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
127262024-12-21T07:59:23.609ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
127272024-12-21T07:59:23.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
127282024-12-21T07:59:23.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127292024-12-21T07:59:23.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
127302024-12-21T07:59:23.617ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127312024-12-21T07:59:23.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127322024-12-21T07:59:23.625ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 113.437675ms iteration = 6 status = {"nsuccess":5}
127332024-12-21T07:59:23.639ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
127342024-12-21T07:59:23.652ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 140.976578ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
127352024-12-21T07:59:23.660ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
127362024-12-21T07:59:23.660ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
127372024-12-21T07:59:23.660ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 149.057347ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
127382024-12-21T07:59:23.660ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
127392024-12-21T07:59:23.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
127402024-12-21T07:59:23.662ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
127412024-12-21T07:59:23.662ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
127422024-12-21T07:59:23.662ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
127432024-12-21T07:59:23.662ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
127442024-12-21T07:59:23.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
127452024-12-21T07:59:23.666ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
127462024-12-21T07:59:23.666ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
127472024-12-21T07:59:23.666ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
127482024-12-21T07:59:23.666ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
127492024-12-21T07:59:23.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
127502024-12-21T07:59:23.667ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127512024-12-21T07:59:23.668ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
127522024-12-21T07:59:23.668ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127532024-12-21T07:59:23.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
127542024-12-21T07:59:23.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
127552024-12-21T07:59:23.672ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
127562024-12-21T07:59:23.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
127572024-12-21T07:59:23.672ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
127582024-12-21T07:59:23.672ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
127592024-12-21T07:59:23.672ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
127602024-12-21T07:59:23.672ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127612024-12-21T07:59:23.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
127622024-12-21T07:59:23.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
127632024-12-21T07:59:23.673ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
127642024-12-21T07:59:23.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
127652024-12-21T07:59:23.675ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
127662024-12-21T07:59:23.675ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127672024-12-21T07:59:23.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127682024-12-21T07:59:23.675ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
127692024-12-21T07:59:23.675ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 0 version = 2
127702024-12-21T07:59:23.675ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
127712024-12-21T07:59:23.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
127722024-12-21T07:59:23.676ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
127732024-12-21T07:59:23.676ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
127742024-12-21T07:59:23.676ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 164.948349ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
127752024-12-21T07:59:23.680ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
127762024-12-21T07:59:23.680ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
127772024-12-21T07:59:23.680ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
127782024-12-21T07:59:23.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
127792024-12-21T07:59:23.682ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127802024-12-21T07:59:23.687ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
127812024-12-21T07:59:23.687ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
127822024-12-21T07:59:23.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
127832024-12-21T07:59:23.688ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
127842024-12-21T07:59:23.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
127852024-12-21T07:59:23.689ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
127862024-12-21T07:59:23.689ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 176.910045ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
127872024-12-21T07:59:23.690ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = fc2bd0cb-5f84-40c1-ac33-b83b0e690eca dns_zone_name = oxide.test found_so_far = 1 version = 2
127882024-12-21T07:59:23.690ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
127892024-12-21T07:59:23.690ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 07:47:25.290148 UTC dns_group = external generation = 2
127902024-12-21T07:59:23.690ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 178.738386ms iteration = 14 status = {"generation":2}
127912024-12-21T07:59:23.692ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
127922024-12-21T07:59:23.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
127932024-12-21T07:59:23.693ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 181.003574ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
127942024-12-21T07:59:23.695ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127952024-12-21T07:59:23.698ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 186.427518ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
127962024-12-21T07:59:23.699ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
127972024-12-21T07:59:23.699ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
127982024-12-21T07:59:23.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
127992024-12-21T07:59:23.701ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 189.300317ms iteration = 25 status = 0
128002024-12-21T07:59:23.704ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128012024-12-21T07:59:23.707ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
128022024-12-21T07:59:23.707ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
128032024-12-21T07:59:23.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
128042024-12-21T07:59:23.709ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 197.789812ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
128052024-12-21T07:59:23.710ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
128062024-12-21T07:59:23.710ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 198.779519ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
128072024-12-21T07:59:23.713ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
128082024-12-21T07:59:23.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
128092024-12-21T07:59:23.715ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128102024-12-21T07:59:23.721ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
128112024-12-21T07:59:23.721ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
128122024-12-21T07:59:23.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
128132024-12-21T07:59:23.728ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 216.28711ms iteration = 28 status = {"physical_disks_added":0}
128142024-12-21T07:59:23.729ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
128152024-12-21T07:59:23.739ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128162024-12-21T07:59:23.744ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
128172024-12-21T07:59:23.744ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
128182024-12-21T07:59:23.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
128192024-12-21T07:59:23.745ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
128202024-12-21T07:59:23.745ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
128212024-12-21T07:59:23.745ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe014a87-1645-44f0-a4eb-f37d936e953b", "content-length": "26", "date": "Sat, 21 Dec 2024 07:59:23 GMT"} })
128222024-12-21T07:59:23.745ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
128232024-12-21T07:59:23.748ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
128242024-12-21T07:59:23.752ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 50d57e93-b609-4414-bd0a-3d0d476ef394 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
128252024-12-21T07:59:23.752ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
128262024-12-21T07:59:23.752ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 07:47:23.936594 UTC dns_group = internal generation = 1
128272024-12-21T07:59:23.752ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 241.93869ms iteration = 14 status = {"generation":1}
128282024-12-21T07:59:23.755ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128292024-12-21T07:59:23.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
128302024-12-21T07:59:23.777ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
128312024-12-21T07:59:23.777ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 265.729128ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
128322024-12-21T07:59:23.792ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:47:21.583817Z, time_modified: 2024-12-21T07:47:21.583817Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: fe5ecf26-3a15-476c-b566-aba979f13c53, db_silo: Silo { identity: SiloIdentity { id: fe5ecf26-3a15-476c-b566-aba979f13c53, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:47:25.231216Z, time_modified: 2024-12-21T07:47:25.231216Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
128332024-12-21T07:59:23.792ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 280.274147ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]}},"default_endpoint":{"silo_id":"fe5ecf26-3a15-476c-b566-aba979f13c53","tls_certs":["74d4a629ff6446bf235cab288e5710f1573908296f08fa7134361dc3ea5fcc2e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
128342024-12-21T07:59:23.836ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
128352024-12-21T07:59:23.836ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
128362024-12-21T07:59:23.836ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "91206b29-b69b-41a1-b67b-b17cdafb75a2", "content-length": "26", "date": "Sat, 21 Dec 2024 07:59:23 GMT"} })
128372024-12-21T07:59:23.836ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
128382024-12-21T07:59:23.838ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
128392024-12-21T07:59:23.842ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
128402024-12-21T07:59:23.842ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
128412024-12-21T07:59:23.843ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "36fc66d6-4f5c-4eb7-84b0-24be792f0a8d", "content-length": "26", "date": "Sat, 21 Dec 2024 07:59:23 GMT"} })
128422024-12-21T07:59:23.843ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
128432024-12-21T07:59:23.846ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
128442024-12-21T07:59:23.873ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128452024-12-21T07:59:23.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
128462024-12-21T07:59:23.876ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128472024-12-21T07:59:23.878ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
128482024-12-21T07:59:23.878ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128492024-12-21T07:59:23.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
128502024-12-21T07:59:23.881ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128512024-12-21T07:59:23.883ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
128522024-12-21T07:59:23.883ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128532024-12-21T07:59:23.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
128542024-12-21T07:59:23.936ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
128552024-12-21T07:59:23.936ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "1fed77ef-f369-4929-a355-358ae11454f8", "date": "Sat, 21 Dec 2024 07:59:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
128562024-12-21T07:59:23.936ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
128572024-12-21T07:59:23.937ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "5d0aecca-c69a-405e-aa06-aaf56bddf2b7", "date": "Sat, 21 Dec 2024 07:59:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
128582024-12-21T07:59:23.937ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
128592024-12-21T07:59:23.939ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
128602024-12-21T07:59:23.939ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
128612024-12-21T07:59:23.939ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 427.968251ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
128622024-12-21T07:59:23.957ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
128632024-12-21T07:59:23.957ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
128642024-12-21T07:59:23.957ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4488ab53-37a2-4e76-8f66-5b9d4fc5dccc", "content-length": "372", "date": "Sat, 21 Dec 2024 07:59:23 GMT"} })
128652024-12-21T07:59:23.957ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128662024-12-21T07:59:23.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128672024-12-21T07:59:23.970ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 458.25398ms iteration = 25 status = {}
128682024-12-21T07:59:23.972ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
128692024-12-21T07:59:23.972ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
128702024-12-21T07:59:23.972ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "13645e7b-86a8-4303-9709-2fdc38ec95a5", "date": "Sat, 21 Dec 2024 07:59:23 GMT"} })
128712024-12-21T07:59:23.972ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128722024-12-21T07:59:23.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128732024-12-21T07:59:23.975ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128742024-12-21T07:59:23.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128752024-12-21T07:59:23.978ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128762024-12-21T07:59:23.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128772024-12-21T07:59:23.981ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
128782024-12-21T07:59:23.981ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
128792024-12-21T07:59:23.982ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a22c0aa8-c42f-4c30-83cc-fc9191eb9ffd", "date": "Sat, 21 Dec 2024 07:59:23 GMT"} })
128802024-12-21T07:59:23.984ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 472.23446ms iteration = 26 status = {}
128812024-12-21T07:59:24.120ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
128822024-12-21T07:59:24.120ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d0188e2c-3539-4066-9059-295e44859d4f", "content-length": "2", "date": "Sat, 21 Dec 2024 07:59:23 GMT"} })
128832024-12-21T07:59:24.122ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
128842024-12-21T07:59:24.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
128852024-12-21T07:59:24.149ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
128862024-12-21T07:59:24.149ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "be93056c-dfe6-4370-9586-0ae7b5f6b209", "date": "Sat, 21 Dec 2024 07:59:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
128872024-12-21T07:59:24.149ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
128882024-12-21T07:59:24.150ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "8045ce6c-0b33-4b0a-a77e-71dad5ce7717", "date": "Sat, 21 Dec 2024 07:59:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
128892024-12-21T07:59:24.150ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
128902024-12-21T07:59:24.152ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "ff33d510-60d4-463d-987a-7391ecf2d49e", "date": "Sat, 21 Dec 2024 07:59:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
128912024-12-21T07:59:24.152ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
128922024-12-21T07:59:24.154ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
128932024-12-21T07:59:24.154ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 642.360387ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
128942024-12-21T07:59:24.165ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
128952024-12-21T07:59:24.167ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 655.600275ms iteration = 25 status = null
128962024-12-21T07:59:24.219ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a503962-6e37-4f88-88c3-efdc9ff0fca0", "content-length": "691", "date": "Sat, 21 Dec 2024 07:59:24 GMT"} })
128972024-12-21T07:59:24.219ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
128982024-12-21T07:59:24.219ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
128992024-12-21T07:59:24.219ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
129002024-12-21T07:59:24.220ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
129012024-12-21T07:59:24.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129022024-12-21T07:59:24.221ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 709.669323ms iteration = 25 status = {}
129032024-12-21T07:59:24.222ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
129042024-12-21T07:59:24.223ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
129052024-12-21T07:59:24.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129062024-12-21T07:59:24.232ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
129072024-12-21T07:59:24.233ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "40f5ce6c-5a9b-4269-89a8-9ac7a1613fd3", "content-length": "134", "date": "Sat, 21 Dec 2024 07:59:23 GMT"} })
129082024-12-21T07:59:24.233ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
129092024-12-21T07:59:24.233ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
129102024-12-21T07:59:24.233ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
129112024-12-21T07:59:24.233ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
129122024-12-21T07:59:24.233ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
129132024-12-21T07:59:24.233ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
129142024-12-21T07:59:24.233ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
129152024-12-21T07:59:24.233ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
129162024-12-21T07:59:24.233ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
129172024-12-21T07:59:24.233ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
129182024-12-21T07:59:24.233ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
129192024-12-21T07:59:24.233ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
129202024-12-21T07:59:24.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129212024-12-21T07:59:24.236ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
129222024-12-21T07:59:24.236ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "22032a8e-1b95-44cc-8cc2-8d74d6dfcc05", "content-length": "2", "date": "Sat, 21 Dec 2024 07:59:23 GMT"} })
129232024-12-21T07:59:24.236ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
129242024-12-21T07:59:24.236ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3601401-ed23-40b0-bbc5-1c85e1a417f4", "content-length": "52", "date": "Sat, 21 Dec 2024 07:59:23 GMT"} })
129252024-12-21T07:59:24.236ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
129262024-12-21T07:59:24.236ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
129272024-12-21T07:59:24.415ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "49303bac-de46-47db-8396-a5c881af834a", "date": "Sat, 21 Dec 2024 07:59:24 GMT"} })
129282024-12-21T07:59:24.415ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
129292024-12-21T07:59:24.415ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
129302024-12-21T07:59:24.415ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "62866a01-1ebb-4084-a711-bcc4d8a47e50", "content-length": "682", "date": "Sat, 21 Dec 2024 07:59:24 GMT"} })
129312024-12-21T07:59:24.415ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
129322024-12-21T07:59:24.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129332024-12-21T07:59:24.419ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
129342024-12-21T07:59:24.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129352024-12-21T07:59:24.424ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
129362024-12-21T07:59:24.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129372024-12-21T07:59:24.426ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
129382024-12-21T07:59:24.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129392024-12-21T07:59:24.434ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 921.998104ms iteration = 25 status = {}
129402024-12-21T07:59:25.902ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1172 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = eac0ed89-75c4-4e67-8d06-b66f3e93833b response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
129412024-12-21T07:59:33.512ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
129422024-12-21T07:59:33.512ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
129432024-12-21T07:59:33.512ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129442024-12-21T07:59:33.512ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
129452024-12-21T07:59:33.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
129462024-12-21T07:59:33.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129472024-12-21T07:59:33.514ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129482024-12-21T07:59:33.517ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
129492024-12-21T07:59:33.517ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129502024-12-21T07:59:33.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129512024-12-21T07:59:33.519ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129522024-12-21T07:59:33.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129532024-12-21T07:59:33.520ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129542024-12-21T07:59:33.523ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
129552024-12-21T07:59:33.523ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129562024-12-21T07:59:33.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129572024-12-21T07:59:33.532ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
129582024-12-21T07:59:33.532ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.790489ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
129592024-12-21T07:59:33.542ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
129602024-12-21T07:59:33.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
129612024-12-21T07:59:33.570ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.233749ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
129622024-12-21T07:59:35.902ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1318 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = fbe777c1-52cb-4a51-b0ae-0723fb7cd587 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
129632024-12-21T07:59:38.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 14d1c4a6-a1f8-4278-b94b-e9688e592d35 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
129642024-12-21T07:59:38.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 14d1c4a6-a1f8-4278-b94b-e9688e592d35 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
129652024-12-21T07:59:38.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3163 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 14d1c4a6-a1f8-4278-b94b-e9688e592d35 response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
129662024-12-21T07:59:43.512ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
129672024-12-21T07:59:43.512ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129682024-12-21T07:59:43.512ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
129692024-12-21T07:59:43.512ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
129702024-12-21T07:59:43.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129712024-12-21T07:59:43.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
129722024-12-21T07:59:43.515ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129732024-12-21T07:59:43.515ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
129742024-12-21T07:59:43.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
129752024-12-21T07:59:43.517ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.66771ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
129762024-12-21T07:59:43.517ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
129772024-12-21T07:59:43.517ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129782024-12-21T07:59:43.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129792024-12-21T07:59:43.519ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129802024-12-21T07:59:43.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129812024-12-21T07:59:43.521ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129822024-12-21T07:59:43.523ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
129832024-12-21T07:59:43.523ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129842024-12-21T07:59:43.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129852024-12-21T07:59:43.534ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
129862024-12-21T07:59:43.534ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.592431ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
129872024-12-21T07:59:45.902ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1152 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 74aa1c94-d6ce-4f3a-94e4-e3110825e561 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
129882024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
129892024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
129902024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
129912024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
129922024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
129932024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
129942024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
129952024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
129962024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
129972024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
129982024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
129992024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
130002024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
130012024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
130022024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
130032024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
130042024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
130052024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
130062024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
130072024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
130082024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
130092024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
130102024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
130112024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
130122024-12-21T07:59:53.512ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
130132024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130142024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
130152024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130162024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
130172024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
130182024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
130192024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
130202024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
130212024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
130222024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
130232024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
130242024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
130252024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
130262024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
130272024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
130282024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
130292024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
130302024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
130312024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
130322024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
130332024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130342024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
130352024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
130362024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
130372024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
130382024-12-21T07:59:53.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130392024-12-21T07:59:53.514ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.162737ms iteration = 26 status = {"errors":[],"finish_invoked_ok":[]}
130402024-12-21T07:59:53.515ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130412024-12-21T07:59:53.515ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130422024-12-21T07:59:53.515ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.519981ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
130432024-12-21T07:59:53.516ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130442024-12-21T07:59:53.517ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
130452024-12-21T07:59:53.517ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
130462024-12-21T07:59:53.517ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
130472024-12-21T07:59:53.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
130482024-12-21T07:59:53.518ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
130492024-12-21T07:59:53.518ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
130502024-12-21T07:59:53.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
130512024-12-21T07:59:53.518ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
130522024-12-21T07:59:53.518ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
130532024-12-21T07:59:53.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
130542024-12-21T07:59:53.519ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
130552024-12-21T07:59:53.519ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
130562024-12-21T07:59:53.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
130572024-12-21T07:59:53.520ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130582024-12-21T07:59:53.521ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
130592024-12-21T07:59:53.521ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1713, tv_nsec: 466749169 } })
130602024-12-21T07:59:53.521ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1713, tv_nsec: 466751969 } })
130612024-12-21T07:59:53.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
130622024-12-21T07:59:53.521ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
130632024-12-21T07:59:53.521ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130642024-12-21T07:59:53.521ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
130652024-12-21T07:59:53.523ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
130662024-12-21T07:59:53.523ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
130672024-12-21T07:59:53.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
130682024-12-21T07:59:53.524ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
130692024-12-21T07:59:53.524ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130702024-12-21T07:59:53.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130712024-12-21T07:59:53.526ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130722024-12-21T07:59:53.527ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
130732024-12-21T07:59:53.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
130742024-12-21T07:59:53.528ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
130752024-12-21T07:59:53.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
130762024-12-21T07:59:53.530ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
130772024-12-21T07:59:53.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130782024-12-21T07:59:53.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130792024-12-21T07:59:53.540ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
130802024-12-21T07:59:53.540ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 27.92955ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
130812024-12-21T07:59:53.541ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.122ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
130822024-12-21T07:59:53.541ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
130832024-12-21T07:59:53.541ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130842024-12-21T07:59:53.541ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130852024-12-21T07:59:53.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130862024-12-21T07:59:53.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
130872024-12-21T07:59:53.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130882024-12-21T07:59:53.543ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c992e3dc-2d80-4655-85d0-78e9a80bf69e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1713, tv_nsec: 488632444 } })
130892024-12-21T07:59:53.543ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
130902024-12-21T07:59:53.543ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
130912024-12-21T07:59:53.543ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130922024-12-21T07:59:53.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
130932024-12-21T07:59:53.544ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
130942024-12-21T07:59:53.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130952024-12-21T07:59:53.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
130962024-12-21T07:59:53.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130972024-12-21T07:59:53.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
130982024-12-21T07:59:53.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130992024-12-21T07:59:53.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
131002024-12-21T07:59:53.553ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
131012024-12-21T07:59:53.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
131022024-12-21T07:59:53.554ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
131032024-12-21T07:59:53.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
131042024-12-21T07:59:53.555ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
131052024-12-21T07:59:53.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
131062024-12-21T07:59:53.556ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131072024-12-21T07:59:53.558ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
131082024-12-21T07:59:53.558ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
131092024-12-21T07:59:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
131102024-12-21T07:59:53.560ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131112024-12-21T07:59:53.562ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
131122024-12-21T07:59:53.562ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
131132024-12-21T07:59:53.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
131142024-12-21T07:59:53.568ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
131152024-12-21T07:59:53.568ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 55.986371ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
131162024-12-21T07:59:53.568ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
131172024-12-21T07:59:53.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
131182024-12-21T07:59:53.570ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
131192024-12-21T07:59:53.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
131202024-12-21T07:59:53.572ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 59.709394ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
131212024-12-21T07:59:53.572ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
131222024-12-21T07:59:53.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
131232024-12-21T07:59:53.574ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
131242024-12-21T07:59:53.574ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
131252024-12-21T07:59:53.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
131262024-12-21T07:59:53.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
131272024-12-21T07:59:53.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
131282024-12-21T07:59:53.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
131292024-12-21T07:59:53.588ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 76.335509ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
131302024-12-21T07:59:53.610ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 98.371667ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
131312024-12-21T07:59:53.619ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
131322024-12-21T07:59:53.619ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
131332024-12-21T07:59:53.620ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "68bf0217-85a9-43e0-a7c1-7bfe04131e23", "content-length": "26", "date": "Sat, 21 Dec 2024 07:59:53 GMT"} })
131342024-12-21T07:59:53.620ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
131352024-12-21T07:59:53.622ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
131362024-12-21T07:59:53.674ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 162.848093ms iteration = 29 status = {"physical_disks_added":0}
131372024-12-21T07:59:53.701ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
131382024-12-21T07:59:53.701ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "dcd149c4-0d4f-43fb-952c-640b7a19e290", "content-length": "691", "date": "Sat, 21 Dec 2024 07:59:53 GMT"} })
131392024-12-21T07:59:53.701ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
131402024-12-21T07:59:53.701ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
131412024-12-21T07:59:53.701ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
131422024-12-21T07:59:53.703ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131432024-12-21T07:59:53.704ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 191.80963ms iteration = 26 status = {}
131442024-12-21T07:59:53.704ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 191.84784ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
131452024-12-21T07:59:53.704ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
131462024-12-21T07:59:53.704ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
131472024-12-21T07:59:53.704ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 192.136766ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
131482024-12-21T07:59:53.706ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c992e3dc-2d80-4655-85d0-78e9a80bf69e, lookup_type: ById(c992e3dc-2d80-4655-85d0-78e9a80bf69e) } result = Ok(())
131492024-12-21T07:59:53.706ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
131502024-12-21T07:59:53.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
131512024-12-21T07:59:53.707ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 195.758147ms iteration = 26 status = 0
131522024-12-21T07:59:53.740ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
131532024-12-21T07:59:53.740ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
131542024-12-21T07:59:53.740ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e850e4f-58dd-4cfc-9433-1c82c70e6f63", "content-length": "26", "date": "Sat, 21 Dec 2024 07:59:53 GMT"} })
131552024-12-21T07:59:53.740ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
131562024-12-21T07:59:53.743ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
131572024-12-21T07:59:53.749ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 zone_address = fd00:1122:3344:101::2
131582024-12-21T07:59:53.749ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
131592024-12-21T07:59:53.750ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f3fc8b3-a320-45cf-8c46-5941ee9113ef", "content-length": "26", "date": "Sat, 21 Dec 2024 07:59:53 GMT"} })
131602024-12-21T07:59:53.750ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
131612024-12-21T07:59:53.751ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
131622024-12-21T07:59:53.751ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
131632024-12-21T07:59:53.751ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
131642024-12-21T07:59:53.752ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b9f6fea-9aef-440a-83bb-f531e8b01339", "content-length": "372", "date": "Sat, 21 Dec 2024 07:59:53 GMT"} })
131652024-12-21T07:59:53.752ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
131662024-12-21T07:59:53.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
131672024-12-21T07:59:53.752ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 240.609777ms iteration = 26 status = {}
131682024-12-21T07:59:53.766ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
131692024-12-21T07:59:53.766ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
131702024-12-21T07:59:53.766ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1f3b2471-cc87-4280-91f9-610c12387988", "date": "Sat, 21 Dec 2024 07:59:53 GMT"} })
131712024-12-21T07:59:53.766ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
131722024-12-21T07:59:53.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
131732024-12-21T07:59:53.769ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
131742024-12-21T07:59:53.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
131752024-12-21T07:59:53.772ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
131762024-12-21T07:59:53.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
131772024-12-21T07:59:53.775ZINFOnexus (BackgroundTasks): VPC route manager sled c992e3dc-2d80-4655-85d0-78e9a80bf69e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
131782024-12-21T07:59:53.775ZDEBGnexus (BackgroundTasks): client request SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
131792024-12-21T07:59:53.775ZDEBGnexus (BackgroundTasks): client response SledAgent = c992e3dc-2d80-4655-85d0-78e9a80bf69e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "23504408-e4f8-4c31-89aa-7cb453837865", "date": "Sat, 21 Dec 2024 07:59:53 GMT"} })
131802024-12-21T07:59:53.777ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 265.289241ms iteration = 27 status = {}
131812024-12-21T07:59:53.811ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
131822024-12-21T07:59:53.811ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "67663692-5bf5-45e2-b940-2ca16e633d7b", "content-length": "2", "date": "Sat, 21 Dec 2024 07:59:53 GMT"} })
131832024-12-21T07:59:53.813ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
131842024-12-21T07:59:53.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
131852024-12-21T07:59:53.815ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 303.580476ms iteration = 26 status = null
131862024-12-21T07:59:53.877ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131872024-12-21T07:59:53.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131882024-12-21T07:59:53.879ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4a835dcb-901c-4acc-aebe-1a4e869f1dac, rack_id: 5b228607-94ff-4bfc-99d8-b10385e90443, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c225c6e7-cc7c-47a1-b563-bc0b10df4673) } rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
131892024-12-21T07:59:53.879ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131902024-12-21T07:59:53.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131912024-12-21T07:59:53.888ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
131922024-12-21T07:59:53.888ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3724e7cb-9d85-4ab5-a917-cff0f71c0931", "content-length": "134", "date": "Sat, 21 Dec 2024 07:59:53 GMT"} })
131932024-12-21T07:59:53.888ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
131942024-12-21T07:59:53.888ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c225c6e7-cc7c-47a1-b563-bc0b10df4673
131952024-12-21T07:59:53.888ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
131962024-12-21T07:59:53.888ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
131972024-12-21T07:59:53.888ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
131982024-12-21T07:59:53.888ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
131992024-12-21T07:59:53.888ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
132002024-12-21T07:59:53.888ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
132012024-12-21T07:59:53.888ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
132022024-12-21T07:59:53.888ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
132032024-12-21T07:59:53.889ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443
132042024-12-21T07:59:53.889ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132052024-12-21T07:59:53.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132062024-12-21T07:59:53.891ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
132072024-12-21T07:59:53.891ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2601a79f-4f17-4125-84c9-c8df1a5e9ef5", "content-length": "2", "date": "Sat, 21 Dec 2024 07:59:53 GMT"} })
132082024-12-21T07:59:53.891ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
132092024-12-21T07:59:53.891ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "38db4623-88fc-4e64-8af2-02040677a003", "content-length": "52", "date": "Sat, 21 Dec 2024 07:59:53 GMT"} })
132102024-12-21T07:59:53.891ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch_location = Switch0
132112024-12-21T07:59:53.891ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
132122024-12-21T07:59:53.990ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a6bcee44-7291-49c0-af82-b8949a36bceb", "date": "Sat, 21 Dec 2024 07:59:53 GMT"} })
132132024-12-21T07:59:53.990ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 switch = Switch0
132142024-12-21T07:59:53.990ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
132152024-12-21T07:59:53.990ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5b228607-94ff-4bfc-99d8-b10385e90443 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a62456da-8921-4ae6-bae1-8769e7442c03", "content-length": "682", "date": "Sat, 21 Dec 2024 07:59:53 GMT"} })
132162024-12-21T07:59:53.990ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132172024-12-21T07:59:53.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132182024-12-21T07:59:53.994ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132192024-12-21T07:59:53.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132202024-12-21T07:59:53.996ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132212024-12-21T07:59:53.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132222024-12-21T07:59:53.998ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132232024-12-21T07:59:53.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132242024-12-21T07:59:54.006ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 494.597563ms iteration = 26 status = {}
132252024-12-21T07:59:55.902ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1118 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = 8cb5aa54-da92-4d19-a6b2-275fad1f77f7 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
132262024-12-21T07:59:56.358ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:41445
132272024-12-21T07:59:56.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41445 req_id = d3541b4e-e1ca-42f2-aa0d-46e8d619d537 roles = RoleSet { roles: {} } uri = /metrics/producers
132282024-12-21T07:59:56.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41445 req_id = d3541b4e-e1ca-42f2-aa0d-46e8d619d537 resource = Database result = Ok(()) uri = /metrics/producers
132292024-12-21T07:59:56.395ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = b2e6180f-2896-4592-b155-f5ca3f904fa7
132302024-12-21T07:59:56.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37096 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41445 req_id = d3541b4e-e1ca-42f2-aa0d-46e8d619d537 response_code = 201 uri = /metrics/producers
132312024-12-21T07:59:56.536ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
132322024-12-21T07:59:56.536ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
132332024-12-21T07:59:56.567ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
132342024-12-21T07:59:56.567ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:51497
132352024-12-21T07:59:56.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:51497 req_id = 97da7fc2-b238-47a5-8993-7d1d9989f198 roles = RoleSet { roles: {} } uri = /metrics/producers
132362024-12-21T07:59:56.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:51497 req_id = 97da7fc2-b238-47a5-8993-7d1d9989f198 resource = Database result = Ok(()) uri = /metrics/producers
132372024-12-21T07:59:56.599ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = 428cd3f9-eecf-4305-9c0b-1698df6403fd
132382024-12-21T07:59:56.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31974 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:51497 req_id = 97da7fc2-b238-47a5-8993-7d1d9989f198 response_code = 201 uri = /metrics/producers
132392024-12-21T07:59:56.599ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "97da7fc2-b238-47a5-8993-7d1d9989f198", "content-length": "41", "date": "Sat, 21 Dec 2024 07:59:56 GMT"} })
132402024-12-21T07:59:56.600ZDEBGnexus (producer-registration-task): registered with nexus successfully
132412024-12-21T07:59:56.600ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
132422024-12-21T08:00:03.512ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
132432024-12-21T08:00:03.512ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
132442024-12-21T08:00:03.512ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132452024-12-21T08:00:03.512ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
132462024-12-21T08:00:03.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132472024-12-21T08:00:03.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132482024-12-21T08:00:03.514ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
132492024-12-21T08:00:03.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132502024-12-21T08:00:03.515ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132512024-12-21T08:00:03.516ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.783635ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
132522024-12-21T08:00:03.517ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
132532024-12-21T08:00:03.517ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132542024-12-21T08:00:03.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132552024-12-21T08:00:03.519ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132562024-12-21T08:00:03.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132572024-12-21T08:00:03.521ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132582024-12-21T08:00:03.523ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
132592024-12-21T08:00:03.523ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132602024-12-21T08:00:03.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132612024-12-21T08:00:03.532ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
132622024-12-21T08:00:03.532ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.334192ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
132632024-12-21T08:00:05.902ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1136 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = d48fe56e-ac0f-4d89-ae1f-25e4f2e56a75 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
132642024-12-21T08:00:08.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 44e1549e-f175-4696-99fd-caf91146f5d2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
132652024-12-21T08:00:08.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 44e1549e-f175-4696-99fd-caf91146f5d2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
132662024-12-21T08:00:08.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3353 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62166 req_id = 44e1549e-f175-4696-99fd-caf91146f5d2 response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
132672024-12-21T08:00:11.180ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:53625
132682024-12-21T08:00:11.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:53625 req_id = f81b4c52-baaf-4880-b821-309599bad14f roles = RoleSet { roles: {} } uri = /metrics/producers
132692024-12-21T08:00:11.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:53625 req_id = f81b4c52-baaf-4880-b821-309599bad14f resource = Database result = Ok(()) uri = /metrics/producers
132702024-12-21T08:00:11.220ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = 42bd0fec-23e2-48f9-bdad-7989f94730a0
132712024-12-21T08:00:11.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39994 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:53625 req_id = f81b4c52-baaf-4880-b821-309599bad14f response_code = 201 uri = /metrics/producers
132722024-12-21T08:00:13.512ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
132732024-12-21T08:00:13.512ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
132742024-12-21T08:00:13.512ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
132752024-12-21T08:00:13.512ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132762024-12-21T08:00:13.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132772024-12-21T08:00:13.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132782024-12-21T08:00:13.514ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
132792024-12-21T08:00:13.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132802024-12-21T08:00:13.514ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132812024-12-21T08:00:13.515ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.49106ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
132822024-12-21T08:00:13.517ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
132832024-12-21T08:00:13.517ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132842024-12-21T08:00:13.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132852024-12-21T08:00:13.518ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132862024-12-21T08:00:13.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132872024-12-21T08:00:13.519ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132882024-12-21T08:00:13.522ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3f45718f-9869-448a-a087-788e66db5e9d, lookup_type: ById(3f45718f-9869-448a-a087-788e66db5e9d) } result = Ok(())
132892024-12-21T08:00:13.522ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132902024-12-21T08:00:13.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132912024-12-21T08:00:13.532ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3f45718f-9869-448a-a087-788e66db5e9d original_time_created = 2024-12-21 07:47:14.929401 UTC target_id = 3f45718f-9869-448a-a087-788e66db5e9d time_created = 2024-12-21 07:47:14.929401 UTC
132922024-12-21T08:00:13.532ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.607433ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3f45718f-9869-448a-a087-788e66db5e9d","time_created":"2024-12-21T07:47:14.929401Z"}
132932024-12-21T08:00:15.784ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:39116
132942024-12-21T08:00:15.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39116 req_id = 218442f0-dd87-4b05-8c79-5262c19074aa roles = RoleSet { roles: {} } uri = /metrics/producers
132952024-12-21T08:00:15.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39116 req_id = 218442f0-dd87-4b05-8c79-5262c19074aa resource = Database result = Ok(()) uri = /metrics/producers
132962024-12-21T08:00:15.798ZINFOnexus: assigned collector to new producer collector_id = cd9693cc-b2a2-4b9b-beee-fc2908a9238e file = nexus/src/app/oximeter.rs:76 producer_id = cae81b8e-6ade-45fa-953a-26f79465611b
132972024-12-21T08:00:15.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 13835 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39116 req_id = 218442f0-dd87-4b05-8c79-5262c19074aa response_code = 201 uri = /metrics/producers
132982024-12-21T08:00:15.903ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1139 local_addr = [fd00:1122:3344:101::b]:63928 method = GET remote_addr = [fd00:1122:3344:101::d]:33709 req_id = a55f7484-dae8-4288-8d4d-3f0c94fa2fd4 response_code = 200 uri = /428cd3f9-eecf-4305-9c0b-1698df6403fd
132992024-12-21T08:00:20.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 82a820f9-f7ad-42e1-be70-58458b98c0e4 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
133002024-12-21T08:00:20.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 82a820f9-f7ad-42e1-be70-58458b98c0e4 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
133012024-12-21T08:00:20.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2327 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 82a820f9-f7ad-42e1-be70-58458b98c0e4 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?sort_by=id_ascending
133022024-12-21T08:00:20.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 667fa230-c0d6-4131-852a-ca1242815810 roles = RoleSet { roles: {} } uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
133032024-12-21T08:00:20.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 667fa230-c0d6-4131-852a-ca1242815810 resource = Database result = Ok(()) uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D
133042024-12-21T08:00:20.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2534 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58236 req_id = 667fa230-c0d6-4131-852a-ca1242815810 response_code = 200 uri = /metrics/collectors/cd9693cc-b2a2-4b9b-beee-fc2908a9238e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjYWU4MWI4ZS02YWRlLTQ1ZmEtOTUzYS0yNmY3OTQ2NTYxMWIifX0%3D