Max level shown:
1 [ Nov 27 18:34:19 Enabled. ]
2 [ Nov 27 18:34:19 Rereading configuration. ]
3 [ Nov 27 18:34:22 Rereading configuration. ]
4 [ Nov 27 18:34:29 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/omicron-nexus/bin/nexus /var/svc/manifest/site/nexus/config.toml &"). ]
5 [ Nov 27 18:34:29 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72024-11-27T18:34:30.069ZDEBGnexus: registered DTrace probes
82024-11-27T18:34:30.072ZINFOnexus: setting up nexus server file = nexus/src/lib.rs:75
92024-11-27T18:34:30.081ZINFOnexus (ServerContext): registering Oso class class = Action file = nexus/auth/src/authz/oso_generic.rs:68
102024-11-27T18:34:30.081ZINFOnexus (ServerContext): registering Oso class class = AnyActor file = nexus/auth/src/authz/oso_generic.rs:68
112024-11-27T18:34:30.081ZINFOnexus (ServerContext): registering Oso class class = AuthenticatedActor file = nexus/auth/src/authz/oso_generic.rs:68
122024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = BlueprintConfig file = nexus/auth/src/authz/oso_generic.rs:68
132024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = Database file = nexus/auth/src/authz/oso_generic.rs:68
142024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = DnsConfig file = nexus/auth/src/authz/oso_generic.rs:68
152024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = Fleet file = nexus/auth/src/authz/oso_generic.rs:68
162024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = Inventory file = nexus/auth/src/authz/oso_generic.rs:68
172024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = IpPoolList file = nexus/auth/src/authz/oso_generic.rs:68
182024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = ConsoleSessionList file = nexus/auth/src/authz/oso_generic.rs:68
192024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequestList file = nexus/auth/src/authz/oso_generic.rs:68
202024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = SiloCertificateList file = nexus/auth/src/authz/oso_generic.rs:68
212024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = SiloIdentityProviderList file = nexus/auth/src/authz/oso_generic.rs:68
222024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = SiloUserList file = nexus/auth/src/authz/oso_generic.rs:68
232024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = Project file = nexus/auth/src/authz/oso_generic.rs:68
242024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = Disk file = nexus/auth/src/authz/oso_generic.rs:68
252024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = Snapshot file = nexus/auth/src/authz/oso_generic.rs:68
262024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = ProjectImage file = nexus/auth/src/authz/oso_generic.rs:68
272024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = Instance file = nexus/auth/src/authz/oso_generic.rs:68
282024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = IpPool file = nexus/auth/src/authz/oso_generic.rs:68
292024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = InstanceNetworkInterface file = nexus/auth/src/authz/oso_generic.rs:68
302024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = Vpc file = nexus/auth/src/authz/oso_generic.rs:68
312024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = VpcRouter file = nexus/auth/src/authz/oso_generic.rs:68
322024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = InternetGateway file = nexus/auth/src/authz/oso_generic.rs:68
332024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpPool file = nexus/auth/src/authz/oso_generic.rs:68
342024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpAddress file = nexus/auth/src/authz/oso_generic.rs:68
352024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = RouterRoute file = nexus/auth/src/authz/oso_generic.rs:68
362024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = VpcSubnet file = nexus/auth/src/authz/oso_generic.rs:68
372024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = FloatingIp file = nexus/auth/src/authz/oso_generic.rs:68
382024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = Image file = nexus/auth/src/authz/oso_generic.rs:68
392024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = SiloImage file = nexus/auth/src/authz/oso_generic.rs:68
402024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = AddressLot file = nexus/auth/src/authz/oso_generic.rs:68
412024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = Blueprint file = nexus/auth/src/authz/oso_generic.rs:68
422024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = LoopbackAddress file = nexus/auth/src/authz/oso_generic.rs:68
432024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = Certificate file = nexus/auth/src/authz/oso_generic.rs:68
442024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = ConsoleSession file = nexus/auth/src/authz/oso_generic.rs:68
452024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequest file = nexus/auth/src/authz/oso_generic.rs:68
462024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = DeviceAccessToken file = nexus/auth/src/authz/oso_generic.rs:68
472024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = PhysicalDisk file = nexus/auth/src/authz/oso_generic.rs:68
482024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = Rack file = nexus/auth/src/authz/oso_generic.rs:68
492024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = RoleBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
502024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = SshKey file = nexus/auth/src/authz/oso_generic.rs:68
512024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = Silo file = nexus/auth/src/authz/oso_generic.rs:68
522024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = SiloUser file = nexus/auth/src/authz/oso_generic.rs:68
532024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = SiloGroup file = nexus/auth/src/authz/oso_generic.rs:68
542024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = IdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
552024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = SamlIdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
562024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = Sled file = nexus/auth/src/authz/oso_generic.rs:68
572024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = TufRepo file = nexus/auth/src/authz/oso_generic.rs:68
582024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = TufArtifact file = nexus/auth/src/authz/oso_generic.rs:68
592024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = Zpool file = nexus/auth/src/authz/oso_generic.rs:68
602024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = Service file = nexus/auth/src/authz/oso_generic.rs:68
612024-11-27T18:34:30.082ZINFOnexus (ServerContext): registering Oso class class = UserBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
622024-11-27T18:34:30.082ZINFOnexus (ServerContext): full Oso configuration config = #\n# Oso configuration for Omicron\n# This file is augmented by generated snippets.\n#\n\n#\n# ACTOR TYPES AND BASIC RULES\n#\n\n# `AnyActor` includes both authenticated and unauthenticated users.\nactor AnyActor {}\n\n# An `AuthenticatedActor` has an identity in the system. All of our operations\n# today require that an actor be authenticated.\nactor AuthenticatedActor {}\n\n# For any resource, `actor` can perform action `action` on it if they're\n# authenticated and their role(s) give them the corresponding permission on that\n# resource.\nallow(actor: AnyActor, action: Action, resource) if\n actor.authenticated and\n has_permission(actor.authn_actor.unwrap(), action.to_perm(), resource);\n\n# Define role relationships\nhas_role(actor: AuthenticatedActor, role: String, resource: Resource)\n\tif resource.has_role(actor, role);\n\n#\n# ROLES AND PERMISSIONS IN THE FLEET/SILO/PROJECT HIERARCHY\n#\n# We define the following permissions for most resources in the system:\n#\n# - "create_child": required to create child resources (of any type)\n#\n# - "list_children": required to list child resources (of all types) of a\n# resource\n#\n# - "modify": required to modify or delete a resource\n#\n# - "read": required to read a resource\n#\n# We define the following predefined roles for only a few high-level resources:\n# the Fleet (see below), Silo, Organization, and Project. The specific roles\n# are oriented around intended use-cases:\n#\n# - "admin": has all permissions on the resource\n#\n# - "collaborator": has "read", "list_children", and "create_child", plus\n# the "admin" role for child resources. The idea is that if you're an\n# Organization Collaborator, you have full control over the Projects within\n# the Organization, but you cannot modify or delete the Organization itself.\n#\n# - "viewer": has "read" and "list_children" on a resource\n#\n# Below the Project level, permissions are granted via roles at the Project\n# level. For example, for someone to be able to create, modify, or delete any\n# Instances, they must be granted project.collaborator, which means they can\n# create, modify, or delete _all_ resources in the Project.\n#\n# The complete set of predefined roles:\n#\n# - fleet.admin (superuser for the whole system)\n# - fleet.collaborator (can manage Silos)\n# - fleet.viewer (can read most non-siloed resources in the system)\n# - silo.admin (superuser for the silo)\n# - silo.collaborator (can create and own Organizations)\n# - silo.viewer (can read most resources within the Silo)\n# - organization.admin (complete control over an organization)\n# - organization.collaborator (can manage Projects)\n# - organization.viewer (can read most resources within the Organization)\n# - project.admin (complete control over a Project)\n# - project.collaborator (can manage all resources within the Project)\n# - project.viewer (can read most resources within the Project)\n#\n# Outside the Silo/Organization/Project hierarchy, we (currently) treat most\n# resources as nested under Fleet or else a synthetic resource (see below). We\n# do not yet support role assignments on anything other than Fleet, Silo,\n# Organization, or Project.\n#\n\n# "Fleet" is a global singleton representing the whole system. The name comes\n# from the idea described in RFD 24, but it's not quite right. This probably\n# should be more like "Region" or "AvailabilityZone". The precise boundaries\n# have not yet been figured out.\nresource Fleet {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\troles = [\n\t # Roles that can be attached by users\n\t "admin",\n\t "collaborator",\n\t "viewer",\n\n\t # Internal-only roles\n\t "external-authenticator"\n\t];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n}\n\n# For fleets specifically, roles can be conferred by roles on the user's Silo.\nhas_role(actor: AuthenticatedActor, role: String, _: Fleet) if\n\tsilo_role in actor.confers_fleet_role(role) and\n\thas_role(actor, silo_role, actor.silo.unwrap());\n\nresource Silo {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Permissions implied by roles on this resource's parent (Fleet). Fleet\n\t# privileges allow a user to see and potentially administer the Silo,\n\t# but they do not give anyone permission to look at anything inside the\n\t# Silo. To achieve this, we use permission rules here. (If we granted\n\t# Fleet administrators _roles_ on the Silo, then those would cascade\n\t# into the Silo as well.)\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "collaborator" on "parent_fleet";\n\n\t# external authenticator has to create silo users\n\t"list_children" if "external-authenticator" on "parent_fleet";\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", silo: Silo)\n\tif silo.fleet = fleet;\n\n# As a special case, all authenticated users can read their own Silo. That's\n# not quite the same as having the "viewer" role. For example, they cannot list\n# Organizations in the Silo.\n#\n# One reason this is necessary is because if an unprivileged user tries to\n# create an Organization using "POST /organizations", they should get back a 403\n# (which implies they're able to see /organizations, which is essentially seeing\n# the Silo itself) rather than a 404. This behavior isn't a hard constraint\n# (i.e., you could reasonably get a 404 for an API you're not allowed to call).\n# Nor is the implementation (i.e., we could special-case this endpoint somehow).\n# But granting this permission is the simplest way to keep this endpoint's\n# behavior consistent with the rest of the API.\n#\n# This rule is also used to determine if a user can list the identity providers\n# in the Silo (which they should be able to), since that's predicated on being\n# able to read the Silo.\n#\n# It's unclear what else would break if users couldn't see their own Silo.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif silo in actor.silo;\n\nresource Project {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Roles implied by roles on this resource's parent (Silo)\n\trelations = { parent_silo: Silo };\n\t"admin" if "collaborator" on "parent_silo";\n\t"viewer" if "viewer" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", project: Project)\n\tif project.silo = silo;\n\n#\n# GENERAL RESOURCES OUTSIDE THE SILO/PROJECT HIERARCHY\n#\n# Many resources use snippets of Polar generated by the `authz_resource!` Rust\n# macro. Some resources require custom Polar code. Those appear here.\n#\n\nresource Certificate {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Fleet-level and silo-level roles both grant privileges on certificates.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", certificate: Certificate)\n\tif certificate.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", certificate: Certificate)\n\tif certificate.silo.fleet = fleet;\n\nresource SiloUser {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\t# Fleet and Silo administrators can manage a Silo's users. This is one\n\t# of the only areas of Silo configuration that Fleet Administrators have\n\t# permissions on.\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "read" on "parent_fleet";\n\t"read" if "read" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", user: SiloUser)\n\tif user.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", user: SiloUser)\n\tif user.silo.fleet = fleet;\n\n# authenticated actors have all permissions on themselves\nhas_permission(actor: AuthenticatedActor, _perm: String, silo_user: SiloUser)\n if actor.equals_silo_user(silo_user);\n\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if silo_user.silo in actor.silo;\n\nresource SiloGroup {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\trelations = { parent_silo: Silo };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", group: SiloGroup)\n\tif group.silo = silo;\n\nresource SshKey {\n\tpermissions = [ "read", "modify" ];\n\trelations = { silo_user: SiloUser };\n\n\t"read" if "read" on "silo_user";\n\t"modify" if "modify" on "silo_user";\n}\nhas_relation(user: SiloUser, "silo_user", ssh_key: SshKey)\n\tif ssh_key.silo_user = user;\n\nresource IdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", identity_provider: IdentityProvider)\n\tif identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: IdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource SamlIdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", saml_identity_provider: SamlIdentityProvider)\n\tif saml_identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SamlIdentityProvider)\n\tif collection.silo.fleet = fleet;\n\n#\n# SYNTHETIC RESOURCES OUTSIDE THE SILO HIERARCHY\n#\n# The resources here do not correspond to anything that appears explicitly in\n# the API or is stored in the database. These are used either at the top level\n# of the API path (e.g., "/v1/system/ip-pools") or as an implementation detail of the system\n# (in the case of console sessions and "Database"). The policies are\n# either statically-defined in this file or driven by role assignments on the\n# Fleet. None of these resources defines their own roles.\n#\n\n# Describes the policy for reading and modifying DNS configuration\n# (both internal and external)\nresource DnsConfig {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t# "external-authenticator" requires these permissions because that's the\n\t# context that Nexus uses when creating and deleting Silos. These\n\t# operations necessarily need to read and modify DNS configuration.\n\t"read" if "external-authenticator" on "parent_fleet";\n\t"modify" if "external-authenticator" on "parent_fleet";\n\t# "admin" on the parent fleet also gets these permissions, primarily for\n\t# the test suite.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", dns_config: DnsConfig)\n\tif dns_config.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource BlueprintConfig {\n\tpermissions = [\n\t "list_children", # list blueprints\n\t "create_child", # create blueprint\n\t "read", # read the current target\n\t "modify", # change the current target\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"read" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", list: BlueprintConfig)\n\tif list.fleet = fleet;\n\n# Describes the policy for reading and modifying low-level inventory\nresource Inventory {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", inventory: Inventory)\n\tif inventory.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/ip-pools" in the API\nresource IpPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the IP Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list IP Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", ip_pool_list: IpPoolList)\n\tif ip_pool_list.fleet = fleet;\n\n# Any authenticated user can create a child of a provided IP Pool.\n# This is necessary to use the pools when provisioning instances.\nhas_permission(actor: AuthenticatedActor, "create_child", ip_pool: IpPool)\n\tif silo in actor.silo and silo.fleet = ip_pool.fleet;\n\n# Describes the policy for creating and managing web console sessions.\nresource ConsoleSessionList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: ConsoleSessionList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing device authorization requests.\nresource DeviceAuthRequestList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: DeviceAuthRequestList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing Silo certificates\nresource SiloCertificateList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Both Fleet and Silo administrators can see and modify the Silo's\n\t# certificates.\n\t"list_children" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloCertificateList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloCertificateList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo identity providers\nresource SiloIdentityProviderList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the identity providers in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's identity provider\n\t# configuration. This is one of the only areas of Silo configuration\n\t# that Fleet Administrators have permissions on. This is also one of\n\t# the only cases where we need to look two levels up the hierarchy to\n\t# see if somebody has the right permission. For most other things,\n\t# permissions cascade down the hierarchy so we only need to look at the\n\t# parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloIdentityProviderList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloIdentityProviderList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo users (mostly intended for\n# API-managed users)\nresource SiloUserList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the users in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's users. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloUserList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloUserList)\n\tif collection.silo.fleet = fleet;\n\n# These rules grants the external authenticator role the permissions it needs to\n# read silo users and modify their sessions. This is necessary for login to\n# work.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif has_role(actor, "external-authenticator", silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\n\n# All authenticated users can read and delete device authn requests because\n# by necessity these operations happen before we've figured out what user (or\n# even Silo) the device auth is associated with. Any user can claim a device\n# auth request with the right user code (that's how it works) -- it's the user\n# code and associated logic that prevents unauthorized access here.\nhas_permission(_actor: AuthenticatedActor, "read", _device_auth: DeviceAuthRequest);\nhas_permission(_actor: AuthenticatedActor, "modify", _device_auth: DeviceAuthRequest);\n\nhas_permission(actor: AuthenticatedActor, "read", device_token: DeviceAccessToken)\n\tif has_role(actor, "external-authenticator", device_token.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", identity_provider: IdentityProvider)\n\tif has_role(actor, "external-authenticator", identity_provider.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", saml_identity_provider: SamlIdentityProvider)\n\tif has_role(actor, "external-authenticator", saml_identity_provider.silo.fleet);\n\n# Describes the policy for who can access the internal database.\nresource Database {\n\tpermissions = [\n\t # "query" is required to perform any query against the database,\n\t # whether a read or write query. This is checked when an operation\n\t # checks out a database connection from the connection pool.\n\t #\n\t # Any authenticated user gets this permission. There's generally\n\t # some other authz check involved in the database query. For\n\t # example, if you're querying the database to "read" a "Project", we\n\t # should also be checking that. So why do we do this at all? It's\n\t # a belt-and-suspenders measure so that if we somehow introduced an\n\t # unauthenticated code path that hits the database, it cannot be\n\t # used to DoS the database because we won't allow the operation to\n\t # make the query. (As long as the code path _is_ authenticated, we\n\t # can use throttling mechanisms to prevent DoS.)\n\t "query",\n\n\t # "modify" is required to populate database data that's delivered\n\t # with the system. It should also be required for schema changes,\n\t # when we support those. This is separate from "query" so that we\n\t # cannot accidentally invoke these code paths from API calls and\n\t # other general functions.\n\t "modify"\n\t];\n}\n\n# All authenticated users have the "query" permission on the database.\nhas_permission(_actor: AuthenticatedActor, "query", _resource: Database);\n\n# The "db-init" user is the only one with the "modify" permission.\nhas_permission(USER_DB_INIT: AuthenticatedActor, "modify", _resource: Database);\nhas_permission(USER_DB_INIT: AuthenticatedActor, "create_child", _resource: IpPoolList);\n# It also has "admin" on the internal silo to populate it with built-in resources.\n# TODO-completeness: actually limit to just internal silo and not all silos\nhas_role(USER_DB_INIT: AuthenticatedActor, "admin", _silo: Silo);\n\n# Allow the internal API admin permissions on all silos.\nhas_role(USER_INTERNAL_API: AuthenticatedActor, "admin", _silo: Silo);\n\n\n\n resource Disk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Disk)\n if child.project = parent;\n \n\n resource Snapshot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Snapshot)\n if child.project = parent;\n \n\n resource ProjectImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ProjectImage)\n if child.project = parent;\n \n\n resource Instance {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Instance)\n if child.project = parent;\n \n\n resource IpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: IpPool)\n if child.fleet = fleet;\n \n\n resource InstanceNetworkInterface {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Instance\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InstanceNetworkInterface)\n if has_relation(project, "containing_project", child.instance);\n\n has_relation(parent: Instance, "parent", child: InstanceNetworkInterface)\n if child.instance = parent;\n \n\n resource Vpc {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Vpc)\n if child.project = parent;\n \n\n resource VpcRouter {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcRouter)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcRouter)\n if child.vpc = parent;\n \n\n resource InternetGateway {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGateway)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: InternetGateway)\n if child.vpc = parent;\n \n\n resource InternetGatewayIpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpPool)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpPool)\n if child.internet_gateway = parent;\n \n\n resource InternetGatewayIpAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpAddress)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpAddress)\n if child.internet_gateway = parent;\n \n\n resource RouterRoute {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: VpcRouter\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: RouterRoute)\n if has_relation(project, "containing_project", child.vpc_router);\n\n has_relation(parent: VpcRouter, "parent", child: RouterRoute)\n if child.vpc_router = parent;\n \n\n resource VpcSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcSubnet)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcSubnet)\n if child.vpc = parent;\n \n\n resource FloatingIp {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: FloatingIp)\n if child.project = parent;\n \n\n resource Image {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: Image)\n if child.silo = parent;\n \n\n resource SiloImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: SiloImage)\n if child.silo = parent;\n \n\n resource AddressLot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AddressLot)\n if child.fleet = fleet;\n \n\n resource Blueprint {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Blueprint)\n if child.fleet = fleet;\n \n\n resource LoopbackAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: LoopbackAddress)\n if child.fleet = fleet;\n \n\n\n resource ConsoleSession {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: ConsoleSession)\n if child.fleet = fleet;\n \n\n resource DeviceAuthRequest {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAuthRequest)\n if child.fleet = fleet;\n \n\n resource DeviceAccessToken {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAccessToken)\n if child.fleet = fleet;\n \n\n resource PhysicalDisk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: PhysicalDisk)\n if child.fleet = fleet;\n \n\n resource Rack {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Rack)\n if child.fleet = fleet;\n \n\n resource RoleBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: RoleBuiltin)\n if child.fleet = fleet;\n \n\n\n\n\n\n\n\n resource Sled {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Sled)\n if child.fleet = fleet;\n \n\n resource TufRepo {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufRepo)\n if child.fleet = fleet;\n \n\n resource TufArtifact {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufArtifact)\n if child.fleet = fleet;\n \n\n resource Zpool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Zpool)\n if child.fleet = fleet;\n \n\n resource Service {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Service)\n if child.fleet = fleet;\n \n\n resource UserBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: UserBuiltin)\n if child.fleet = fleet;\n file = nexus/auth/src/authz/oso_generic.rs:89
632024-11-27T18:34:30.097ZINFOnexus (ServerContext): Setting up resolver using DNS servers for subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344::, width: 48 } } file = nexus/src/context.rs:219
642024-11-27T18:34:30.100ZINFOnexus (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
652024-11-27T18:34:30.104ZINFOnexus (ServerContext): Setting up qorb database pool from DNS dns_addrs = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = nexus/src/context.rs:275
662024-11-27T18:34:30.112ZDEBGnexus (ServerContext): registered USDT probes
672024-11-27T18:34:30.156ZINFOnexus: Database schema version is up to date desired_version = 116.0.0 file = nexus/db-queries/src/db/datastore/db_metadata.rs:145 found_version = 116.0.0
682024-11-27T18:34:30.159ZINFOnexus (SEC): SEC running file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:813 sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
692024-11-27T18:34:30.160ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2104, tv_nsec: 158486586 } })
702024-11-27T18:34:30.161ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
712024-11-27T18:34:30.209ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
722024-11-27T18:34:30.209ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
732024-11-27T18:34:30.212ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7e15eea-93a5-41d0-86d8-7d51bd7a5112", "content-length": "26", "date": "Wed, 27 Nov 2024 18:34:30 GMT"} })
742024-11-27T18:34:30.213ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
752024-11-27T18:34:30.213ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
762024-11-27T18:34:30.243ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2104, tv_nsec: 241972494 } })
772024-11-27T18:34:30.243ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
782024-11-27T18:34:30.277ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
792024-11-27T18:34:30.277ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
802024-11-27T18:34:30.277ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bae2a1b3-62c1-422f-95b1-b74a93600302", "content-length": "26", "date": "Wed, 27 Nov 2024 18:34:30 GMT"} })
812024-11-27T18:34:30.277ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
822024-11-27T18:34:30.277ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
832024-11-27T18:34:30.344ZDEBGnexus (clickhouse-client): registered USDT probes id = 3d35e8b2-24d2-4baf-9fef-97cef2908a8d
842024-11-27T18:34:30.350ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
852024-11-27T18:34:30.357ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
862024-11-27T18:34:30.358ZDEBGnexus (DataLoader): attempting to create built-in users
872024-11-27T18:34:30.358ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
882024-11-27T18:34:30.358ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
892024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /artifacts/{kind}/{name}/{version} versions = all
902024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /bgtasks versions = all
912024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /bgtasks/activate versions = all
922024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /bgtasks/view/{bgtask_name} versions = all
932024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /clickhouse/policy versions = all
942024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /clickhouse/policy versions = all
952024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stop-request versions = all
962024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stopped versions = all
972024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair/{repair_id}/progress versions = all
982024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-finish versions = all
992024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-start versions = all
1002024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /demo-saga versions = all
1012024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /demo-saga/{demo_saga_id}/complete versions = all
1022024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/all versions = all
1032024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = DELETE path = /deployment/blueprints/all/{blueprint_id} versions = all
1042024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/all/{blueprint_id} versions = all
1052024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/import versions = all
1062024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/regenerate versions = all
1072024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/target versions = all
1082024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/target versions = all
1092024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /deployment/blueprints/target/enabled versions = all
1102024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /disk/{disk_id}/remove-read-only-parent versions = all
1112024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /disks/{disk_id} versions = all
1122024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /instances/{instance_id}/migrate versions = all
1132024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /metrics/collectors versions = all
1142024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /metrics/collectors/{collector_id}/producers versions = all
1152024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /metrics/producers versions = all
1162024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /nat/ipv4/changeset/{from_gen} versions = all
1172024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /physical-disk/expunge versions = all
1182024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /probes/{sled} versions = all
1192024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /racks/{rack_id}/initialization-complete versions = all
1202024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sagas versions = all
1212024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sagas/{saga_id} versions = all
1222024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sled-agents/{sled_id} versions = all
1232024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sled-agents/{sled_id} versions = all
1242024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sled-agents/{sled_id}/firewall-rules-update versions = all
1252024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sleds/add versions = all
1262024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sleds/expunge versions = all
1272024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sleds/uninitialized versions = all
1282024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /switch/{switch_id} versions = all
1292024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /vmms/{propolis_id} versions = all
1302024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /volume/{volume_id}/remove-read-only-parent versions = all
1312024-11-27T18:34:30.379ZINFOnexus (dropshot_internal): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::c]:12221
1322024-11-27T18:34:30.379ZDEBGnexus (dropshot_internal): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:12221
1332024-11-27T18:34:30.380ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1342024-11-27T18:34:30.380ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1352024-11-27T18:34:30.411ZWARNnexus: Cannot look up rack: Object (of type ById(62a8af4d-fc95-42f9-a9e4-071aa14ffdb2)) not found: rack file = nexus/src/app/rack.rs:774
1362024-11-27T18:34:30.435ZINFOnexus (DataLoader): created 0 built-in users file = nexus/db-queries/src/db/datastore/silo_user.rs:394
1372024-11-27T18:34:30.435ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1382024-11-27T18:34:30.436ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1392024-11-27T18:34:30.437ZDEBGnexus (DataLoader): attempting to create built-in roles
1402024-11-27T18:34:30.437ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1412024-11-27T18:34:30.437ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1422024-11-27T18:34:30.446ZINFOnexus (DataLoader): created 0 built-in roles file = nexus/db-queries/src/db/datastore/role.rs:85
1432024-11-27T18:34:30.446ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1442024-11-27T18:34:30.448ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1452024-11-27T18:34:30.448ZDEBGnexus (DataLoader): attempting to create built-in role assignments
1462024-11-27T18:34:30.448ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1472024-11-27T18:34:30.448ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1482024-11-27T18:34:30.489ZINFOnexus (DataLoader): created 0 built-in role assignments file = nexus/db-queries/src/db/datastore/role.rs:114
1492024-11-27T18:34:30.489ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1502024-11-27T18:34:30.491ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1512024-11-27T18:34:30.491ZDEBGnexus (DataLoader): attempting to create built-in silos
1522024-11-27T18:34:30.491ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1532024-11-27T18:34:30.491ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1542024-11-27T18:34:30.557ZINFOnexus (DataLoader): created 0 built-in silos file = nexus/db-queries/src/db/datastore/silo.rs:95
1552024-11-27T18:34:30.557ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1562024-11-27T18:34:30.557ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1572024-11-27T18:34:30.566ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1582024-11-27T18:34:30.567ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1592024-11-27T18:34:30.567ZDEBGnexus (DataLoader): attempting to create built-in projects
1602024-11-27T18:34:30.567ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1612024-11-27T18:34:30.567ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1622024-11-27T18:34:30.574ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1632024-11-27T18:34:30.575ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1642024-11-27T18:34:30.604ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1652024-11-27T18:34:30.604ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1662024-11-27T18:34:30.639ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1672024-11-27T18:34:30.641ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1682024-11-27T18:34:30.641ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1692024-11-27T18:34:30.641ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1702024-11-27T18:34:30.684ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1712024-11-27T18:34:30.684ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1722024-11-27T18:34:30.719ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1732024-11-27T18:34:30.721ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1742024-11-27T18:34:30.721ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1752024-11-27T18:34:30.721ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1762024-11-27T18:34:30.777ZINFOnexus (DataLoader): created built-in services project file = nexus/db-queries/src/db/datastore/project.rs:122
1772024-11-27T18:34:30.777ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1782024-11-27T18:34:30.778ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1792024-11-27T18:34:30.778ZDEBGnexus (DataLoader): attempting to create built-in VPCs
1802024-11-27T18:34:30.778ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1812024-11-27T18:34:30.778ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1822024-11-27T18:34:30.787ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1832024-11-27T18:34:30.787ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1842024-11-27T18:34:30.789ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1852024-11-27T18:34:30.790ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1862024-11-27T18:34:30.791ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1872024-11-27T18:34:30.791ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1882024-11-27T18:34:30.825ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1892024-11-27T18:34:30.825ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1902024-11-27T18:34:30.826ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1912024-11-27T18:34:30.830ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
1922024-11-27T18:34:30.830ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1932024-11-27T18:34:30.830ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1942024-11-27T18:34:30.831ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1952024-11-27T18:34:30.832ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1962024-11-27T18:34:30.833ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1972024-11-27T18:34:30.833ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1982024-11-27T18:34:30.835ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1992024-11-27T18:34:30.837ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2002024-11-27T18:34:30.837ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2012024-11-27T18:34:30.837ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2022024-11-27T18:34:30.931ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2032024-11-27T18:34:30.931ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2042024-11-27T18:34:30.932ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2052024-11-27T18:34:30.933ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2062024-11-27T18:34:30.934ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2072024-11-27T18:34:30.934ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2082024-11-27T18:34:30.936ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2092024-11-27T18:34:30.940ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
2102024-11-27T18:34:30.941ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2112024-11-27T18:34:30.941ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2122024-11-27T18:34:30.971ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2132024-11-27T18:34:30.972ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2142024-11-27T18:34:30.976ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2152024-11-27T18:34:30.976ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2162024-11-27T18:34:30.979ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2172024-11-27T18:34:30.979ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2182024-11-27T18:34:30.981ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2192024-11-27T18:34:30.981ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2202024-11-27T18:34:30.982ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2212024-11-27T18:34:30.982ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2222024-11-27T18:34:30.989ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2232024-11-27T18:34:30.989ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2242024-11-27T18:34:30.990ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2252024-11-27T18:34:30.990ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2262024-11-27T18:34:30.991ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2272024-11-27T18:34:30.995ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2282024-11-27T18:34:30.995ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2292024-11-27T18:34:30.995ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2302024-11-27T18:34:30.997ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2312024-11-27T18:34:30.997ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2322024-11-27T18:34:30.998ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2332024-11-27T18:34:30.998ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2342024-11-27T18:34:30.999ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2352024-11-27T18:34:31.003ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2362024-11-27T18:34:31.003ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2372024-11-27T18:34:31.003ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2382024-11-27T18:34:31.051ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:59403
2392024-11-27T18:34:31.059ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2402024-11-27T18:34:31.059ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2412024-11-27T18:34:31.060ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2422024-11-27T18:34:31.061ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2432024-11-27T18:34:31.062ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2442024-11-27T18:34:31.062ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2452024-11-27T18:34:31.064ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2462024-11-27T18:34:31.067ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2472024-11-27T18:34:31.067ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2482024-11-27T18:34:31.067ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2492024-11-27T18:34:31.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 96a88ebc-71f0-47f8-8e94-22b5c0ae619d roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
2502024-11-27T18:34:31.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 96a88ebc-71f0-47f8-8e94-22b5c0ae619d resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
2512024-11-27T18:34:31.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 96a88ebc-71f0-47f8-8e94-22b5c0ae619d roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
2522024-11-27T18:34:31.071ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 96a88ebc-71f0-47f8-8e94-22b5c0ae619d resource = Fleet result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
2532024-11-27T18:34:31.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 96a88ebc-71f0-47f8-8e94-22b5c0ae619d roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
2542024-11-27T18:34:31.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 96a88ebc-71f0-47f8-8e94-22b5c0ae619d resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
2552024-11-27T18:34:31.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 96a88ebc-71f0-47f8-8e94-22b5c0ae619d roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
2562024-11-27T18:34:31.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 96a88ebc-71f0-47f8-8e94-22b5c0ae619d resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
2572024-11-27T18:34:31.139ZDEBGnexus (DataLoader): attempting to create built-in VPC firewall rules
2582024-11-27T18:34:31.139ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2592024-11-27T18:34:31.139ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2602024-11-27T18:34:31.141ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2612024-11-27T18:34:31.142ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2622024-11-27T18:34:31.144ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2632024-11-27T18:34:31.145ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2642024-11-27T18:34:31.147ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2652024-11-27T18:34:31.147ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2662024-11-27T18:34:31.148ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2672024-11-27T18:34:31.149ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2682024-11-27T18:34:31.172ZINFOnexus (dropshot_internal): set cockroachdb setting actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/cockroachdb_settings.rs:124 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 96a88ebc-71f0-47f8-8e94-22b5c0ae619d setting = cluster.preserve_downgrade_option uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete value = 22.1
2692024-11-27T18:34:31.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 96a88ebc-71f0-47f8-8e94-22b5c0ae619d roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
2702024-11-27T18:34:31.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 96a88ebc-71f0-47f8-8e94-22b5c0ae619d resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
2712024-11-27T18:34:31.181ZINFOnexus (dropshot_internal): request completed error_message_external = not found: rack with id "62a8af4d-fc95-42f9-a9e4-071aa14ffdb2" error_message_internal = not found: rack with id "62a8af4d-fc95-42f9-a9e4-071aa14ffdb2" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 129498 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 96a88ebc-71f0-47f8-8e94-22b5c0ae619d response_code = 404 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
2722024-11-27T18:34:31.187ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2732024-11-27T18:34:31.187ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2742024-11-27T18:34:31.189ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2752024-11-27T18:34:31.191ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2762024-11-27T18:34:31.191ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2772024-11-27T18:34:31.192ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2782024-11-27T18:34:31.193ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2792024-11-27T18:34:31.193ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2802024-11-27T18:34:31.236ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2812024-11-27T18:34:31.236ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2822024-11-27T18:34:31.256ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2832024-11-27T18:34:31.259ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2842024-11-27T18:34:31.259ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2852024-11-27T18:34:31.259ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2862024-11-27T18:34:31.276ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2872024-11-27T18:34:31.277ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2882024-11-27T18:34:31.278ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2892024-11-27T18:34:31.278ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2902024-11-27T18:34:31.279ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2912024-11-27T18:34:31.279ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2922024-11-27T18:34:31.281ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2932024-11-27T18:34:31.283ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2942024-11-27T18:34:31.284ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2952024-11-27T18:34:31.284ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2962024-11-27T18:34:31.351ZINFOnexus (DataLoader): created built-in VPC firewall rules file = nexus/db-queries/src/db/datastore/vpc.rs:282
2972024-11-27T18:34:31.351ZDEBGnexus (DataLoader): attempting to create built-in VPC Subnets
2982024-11-27T18:34:31.351ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2992024-11-27T18:34:31.352ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3002024-11-27T18:34:31.364ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3012024-11-27T18:34:31.364ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3022024-11-27T18:34:31.366ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3032024-11-27T18:34:31.366ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3042024-11-27T18:34:31.368ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3052024-11-27T18:34:31.368ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3062024-11-27T18:34:31.369ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3072024-11-27T18:34:31.369ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3082024-11-27T18:34:31.371ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3092024-11-27T18:34:31.371ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3102024-11-27T18:34:31.372ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3112024-11-27T18:34:31.376ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3122024-11-27T18:34:31.376ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3132024-11-27T18:34:31.376ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3142024-11-27T18:34:31.393ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3152024-11-27T18:34:31.393ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3162024-11-27T18:34:31.395ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3172024-11-27T18:34:31.395ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3182024-11-27T18:34:31.397ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3192024-11-27T18:34:31.398ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3202024-11-27T18:34:31.409ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3212024-11-27T18:34:31.409ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3222024-11-27T18:34:31.410ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3232024-11-27T18:34:31.411ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3242024-11-27T18:34:31.412ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3252024-11-27T18:34:31.412ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3262024-11-27T18:34:31.421ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3272024-11-27T18:34:31.426ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ById(001de000-c470-4000-8000-000000000001) } result = Ok(())
3282024-11-27T18:34:31.426ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3292024-11-27T18:34:31.427ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3302024-11-27T18:34:31.430ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3312024-11-27T18:34:31.430ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3322024-11-27T18:34:31.432ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3332024-11-27T18:34:31.432ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3342024-11-27T18:34:31.469ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3352024-11-27T18:34:31.469ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3362024-11-27T18:34:31.472ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3372024-11-27T18:34:31.472ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3382024-11-27T18:34:31.474ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3392024-11-27T18:34:31.474ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3402024-11-27T18:34:31.482ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3412024-11-27T18:34:31.482ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3422024-11-27T18:34:31.484ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3432024-11-27T18:34:31.489ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ById(001de000-c470-4000-8000-000000000002) } result = Ok(())
3442024-11-27T18:34:31.489ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3452024-11-27T18:34:31.489ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3462024-11-27T18:34:31.491ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3472024-11-27T18:34:31.491ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3482024-11-27T18:34:31.493ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3492024-11-27T18:34:31.493ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3502024-11-27T18:34:31.495ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3512024-11-27T18:34:31.495ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3522024-11-27T18:34:31.497ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3532024-11-27T18:34:31.497ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3542024-11-27T18:34:31.498ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3552024-11-27T18:34:31.499ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3562024-11-27T18:34:31.500ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3572024-11-27T18:34:31.501ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3582024-11-27T18:34:31.502ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3592024-11-27T18:34:31.507ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000003, lookup_type: ById(001de000-c470-4000-8000-000000000003) } result = Ok(())
3602024-11-27T18:34:31.507ZINFOnexus (DataLoader): created built-in services vpc subnets file = nexus/db-queries/src/db/datastore/vpc.rs:346
3612024-11-27T18:34:31.507ZINFOnexus (DataLoader): created built-in services vpc file = nexus/db-queries/src/db/datastore/vpc.rs:224
3622024-11-27T18:34:31.507ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3632024-11-27T18:34:31.508ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3642024-11-27T18:34:31.508ZDEBGnexus (DataLoader): attempting to create silo users
3652024-11-27T18:34:31.508ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3662024-11-27T18:34:31.508ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3672024-11-27T18:34:31.527ZINFOnexus (DataLoader): created 0 silo users file = nexus/db-queries/src/db/datastore/silo_user.rs:419
3682024-11-27T18:34:31.527ZDEBGnexus (DataLoader): attempting to create silo user role assignments
3692024-11-27T18:34:31.527ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3702024-11-27T18:34:31.527ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3712024-11-27T18:34:31.530ZINFOnexus (DataLoader): created 0 silo user role assignments file = nexus/db-queries/src/db/datastore/silo_user.rs:446
3722024-11-27T18:34:31.530ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3732024-11-27T18:34:31.530ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3742024-11-27T18:34:31.534ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3752024-11-27T18:34:31.535ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3762024-11-27T18:34:31.555ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3772024-11-27T18:34:31.555ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3782024-11-27T18:34:31.557ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3792024-11-27T18:34:31.558ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = IpPoolList result = Ok(())
3802024-11-27T18:34:31.558ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3812024-11-27T18:34:31.558ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3822024-11-27T18:34:31.570ZINFOnexus: populate complete file = nexus/src/app/mod.rs:527
3832024-11-27T18:34:31.570ZINFOnexus: activating background tasks file = nexus/src/app/mod.rs:536
3842024-11-27T18:34:31.574ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 1 reason = Timeout
3852024-11-27T18:34:31.574ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 1 reason = Timeout
3862024-11-27T18:34:31.574ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 1 reason = Timeout
3872024-11-27T18:34:31.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 1 reason = Timeout
3882024-11-27T18:34:31.574ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
3892024-11-27T18:34:31.574ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 1 reason = Timeout
3902024-11-27T18:34:31.574ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 1 reason = Timeout
3912024-11-27T18:34:31.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 1 reason = Timeout
3922024-11-27T18:34:31.574ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 1 reason = Timeout
3932024-11-27T18:34:31.574ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 1 reason = Timeout
3942024-11-27T18:34:31.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 1 reason = Timeout
3952024-11-27T18:34:31.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 1 reason = Timeout
3962024-11-27T18:34:31.574ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:74 reason = no blueprint
3972024-11-27T18:34:31.574ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 1 reason = Timeout
3982024-11-27T18:34:31.574ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 1 reason = Timeout
3992024-11-27T18:34:31.574ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 1 reason = Timeout
4002024-11-27T18:34:31.574ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 1 reason = Timeout
4012024-11-27T18:34:31.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4022024-11-27T18:34:31.574ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4032024-11-27T18:34:31.574ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 1 reason = Timeout
4042024-11-27T18:34:31.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
4052024-11-27T18:34:31.574ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 1 reason = Timeout
4062024-11-27T18:34:31.574ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4072024-11-27T18:34:31.574ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4082024-11-27T18:34:31.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 1 reason = Timeout
4092024-11-27T18:34:31.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4102024-11-27T18:34:31.574ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-27 18:24:31.574897359 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
4112024-11-27T18:34:31.575ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4122024-11-27T18:34:31.575ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 1 reason = Timeout
4132024-11-27T18:34:31.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 1 reason = Timeout
4142024-11-27T18:34:31.575ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4152024-11-27T18:34:31.575ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4162024-11-27T18:34:31.575ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4172024-11-27T18:34:31.575ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4182024-11-27T18:34:31.575ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
4192024-11-27T18:34:31.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4202024-11-27T18:34:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
4212024-11-27T18:34:31.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
4222024-11-27T18:34:31.575ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
4232024-11-27T18:34:31.575ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
4242024-11-27T18:34:31.575ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
4252024-11-27T18:34:31.576ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 1.41248ms iteration = 1 status = {"error":"no config nor servers"}
4262024-11-27T18:34:31.576ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 1.226739ms iteration = 1 status = {"error":"no blueprint"}
4272024-11-27T18:34:31.576ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4282024-11-27T18:34:31.576ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
4292024-11-27T18:34:31.576ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 1 reason = Timeout
4302024-11-27T18:34:31.576ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
4312024-11-27T18:34:31.576ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 1 reason = Timeout
4322024-11-27T18:34:31.576ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 1 reason = Timeout
4332024-11-27T18:34:31.576ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 1 reason = Timeout
4342024-11-27T18:34:31.576ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 1 reason = Timeout
4352024-11-27T18:34:31.576ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 1 reason = Timeout
4362024-11-27T18:34:31.576ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 1 reason = Timeout
4372024-11-27T18:34:31.576ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("923a7051-0539-4413-bab4-c2b0d3395fe2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2105, tv_nsec: 574658227 } })
4382024-11-27T18:34:31.576ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 1 reason = Timeout
4392024-11-27T18:34:31.576ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 1 reason = Timeout
4402024-11-27T18:34:31.576ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 1 reason = Timeout
4412024-11-27T18:34:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
4422024-11-27T18:34:31.576ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 1 reason = Timeout
4432024-11-27T18:34:31.576ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 1 reason = Timeout
4442024-11-27T18:34:31.576ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 1 reason = Timeout
4452024-11-27T18:34:31.576ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 1 reason = Timeout
4462024-11-27T18:34:31.576ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
4472024-11-27T18:34:31.576ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4482024-11-27T18:34:31.576ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4492024-11-27T18:34:31.576ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4502024-11-27T18:34:31.576ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4512024-11-27T18:34:31.576ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
4522024-11-27T18:34:31.576ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = crdb_node_id_collector file = nexus/src/app/background/tasks/crdb_node_id_collector.rs:78 reason = no blueprint
4532024-11-27T18:34:31.576ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 2.566598ms iteration = 1 status = {"error":"no config nor servers"}
4542024-11-27T18:34:31.576ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 2.437667ms iteration = 1 status = {"error":"no blueprint"}
4552024-11-27T18:34:31.576ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4562024-11-27T18:34:31.576ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
4572024-11-27T18:34:31.576ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
4582024-11-27T18:34:31.576ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4592024-11-27T18:34:31.576ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4602024-11-27T18:34:31.576ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4612024-11-27T18:34:31.576ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
4622024-11-27T18:34:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4632024-11-27T18:34:31.577ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4642024-11-27T18:34:31.577ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4652024-11-27T18:34:31.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4662024-11-27T18:34:31.577ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f378a24-7578-4d72-8454-f489a3e51ffb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e203eafc-5cbd-4249-8d8a-770878ed4d6d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 2105, tv_nsec: 576100528 } })
4672024-11-27T18:34:31.578ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external dns_group = external file = nexus/src/app/background/tasks/dns_servers.rs:113
4682024-11-27T18:34:31.578ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 4.296134ms iteration = 1 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
4692024-11-27T18:34:31.578ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 2 reason = Dependency
4702024-11-27T18:34:31.578ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
4712024-11-27T18:34:31.578ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 13.5\u{b5}s iteration = 2 status = {"error":"no config"}
4722024-11-27T18:34:31.578ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal dns_group = internal file = nexus/src/app/background/tasks/dns_servers.rs:113
4732024-11-27T18:34:31.578ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 4.880923ms iteration = 1 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
4742024-11-27T18:34:31.578ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 2 reason = Dependency
4752024-11-27T18:34:31.578ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
4762024-11-27T18:34:31.578ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 9.86\u{b5}s iteration = 2 status = {"error":"no config"}
4772024-11-27T18:34:31.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
4782024-11-27T18:34:31.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
4792024-11-27T18:34:31.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4802024-11-27T18:34:31.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4812024-11-27T18:34:31.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4822024-11-27T18:34:31.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4832024-11-27T18:34:31.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4842024-11-27T18:34:31.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
4852024-11-27T18:34:31.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4862024-11-27T18:34:31.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
4872024-11-27T18:34:31.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4882024-11-27T18:34:31.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
4892024-11-27T18:34:31.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
4902024-11-27T18:34:31.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4912024-11-27T18:34:31.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4922024-11-27T18:34:31.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4932024-11-27T18:34:31.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
4942024-11-27T18:34:31.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
4952024-11-27T18:34:31.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4962024-11-27T18:34:31.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4972024-11-27T18:34:31.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4982024-11-27T18:34:31.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4992024-11-27T18:34:31.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
5002024-11-27T18:34:31.596ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5012024-11-27T18:34:31.597ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5022024-11-27T18:34:31.600ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5032024-11-27T18:34:31.600ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5042024-11-27T18:34:31.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5052024-11-27T18:34:31.600ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5062024-11-27T18:34:31.600ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5072024-11-27T18:34:31.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5082024-11-27T18:34:31.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5092024-11-27T18:34:31.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5102024-11-27T18:34:31.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5112024-11-27T18:34:31.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5122024-11-27T18:34:31.616ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
5132024-11-27T18:34:31.617ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 43.098429ms iteration = 1 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
5142024-11-27T18:34:31.627ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-27 18:24:31.574897359 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5152024-11-27T18:34:31.627ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 54.020141ms iteration = 1 status = {"expiration":"2024-11-27T18:24:31.574897359Z","pruned":[]}
5162024-11-27T18:34:31.646ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2105, tv_nsec: 645141232 } })
5172024-11-27T18:34:31.647ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
5182024-11-27T18:34:31.648ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5192024-11-27T18:34:31.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5202024-11-27T18:34:31.649ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5212024-11-27T18:34:31.649ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 76.120569ms iteration = 1 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5222024-11-27T18:34:31.652ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
5232024-11-27T18:34:31.653ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
5242024-11-27T18:34:31.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5252024-11-27T18:34:31.655ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 81.287385ms iteration = 1 status = {"errors":[],"found_port_ok":[]}
5262024-11-27T18:34:31.657ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5272024-11-27T18:34:31.658ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5282024-11-27T18:34:31.658ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
5292024-11-27T18:34:31.658ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5302024-11-27T18:34:31.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5312024-11-27T18:34:31.661ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5322024-11-27T18:34:31.661ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 87.896943ms iteration = 1 status = {"errors":[],"records_set_to_done":[]}
5332024-11-27T18:34:31.662ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5342024-11-27T18:34:31.662ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5352024-11-27T18:34:31.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5362024-11-27T18:34:31.663ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5372024-11-27T18:34:31.663ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
5382024-11-27T18:34:31.663ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5392024-11-27T18:34:31.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5402024-11-27T18:34:31.664ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5412024-11-27T18:34:31.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5422024-11-27T18:34:31.667ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5432024-11-27T18:34:31.667ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5442024-11-27T18:34:31.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5452024-11-27T18:34:31.670ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5462024-11-27T18:34:31.670ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 95.895662ms iteration = 1 status = {}
5472024-11-27T18:34:31.670ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5482024-11-27T18:34:31.670ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
5492024-11-27T18:34:31.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5502024-11-27T18:34:31.671ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5512024-11-27T18:34:31.671ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5522024-11-27T18:34:31.671ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = []
5532024-11-27T18:34:31.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5542024-11-27T18:34:31.672ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2105, tv_nsec: 670427147 } })
5552024-11-27T18:34:31.672ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2105, tv_nsec: 670495648 } })
5562024-11-27T18:34:31.672ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
5572024-11-27T18:34:31.674ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5582024-11-27T18:34:31.674ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5592024-11-27T18:34:31.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5602024-11-27T18:34:31.674ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
5612024-11-27T18:34:31.675ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
5622024-11-27T18:34:31.675ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5632024-11-27T18:34:31.676ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 102.034402ms iteration = 1 status = {"errors":[],"garbage_collect_requested":[]}
5642024-11-27T18:34:31.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
5652024-11-27T18:34:31.677ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5662024-11-27T18:34:31.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5672024-11-27T18:34:31.680ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5682024-11-27T18:34:31.682ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5692024-11-27T18:34:31.682ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5702024-11-27T18:34:31.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5712024-11-27T18:34:31.684ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5722024-11-27T18:34:31.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5732024-11-27T18:34:31.687ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:80 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
5742024-11-27T18:34:31.687ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 113.37117ms iteration = 1 status = {"error":"rack not yet initialized: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2"}
5752024-11-27T18:34:31.687ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5762024-11-27T18:34:31.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5772024-11-27T18:34:31.688ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
5782024-11-27T18:34:31.688ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
5792024-11-27T18:34:31.688ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 114.460267ms iteration = 1 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
5802024-11-27T18:34:31.696ZWARNnexus (BackgroundTasks): inventory collection is None background_task = service_zone_nat_tracker file = nexus/src/app/background/tasks/sync_service_zone_nat.rs:95
5812024-11-27T18:34:31.696ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 122.075179ms iteration = 1 status = {"error":"inventory collection is None"}
5822024-11-27T18:34:31.697ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5832024-11-27T18:34:31.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5842024-11-27T18:34:31.700ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5852024-11-27T18:34:31.702ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5862024-11-27T18:34:31.703ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
5872024-11-27T18:34:31.703ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5882024-11-27T18:34:31.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5892024-11-27T18:34:31.704ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
5902024-11-27T18:34:31.704ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5912024-11-27T18:34:31.704ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "395e2175-e529-44f2-a24e-1b593cb6293e", "content-length": "26", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
5922024-11-27T18:34:31.705ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5932024-11-27T18:34:31.706ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5942024-11-27T18:34:31.706ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5952024-11-27T18:34:31.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5962024-11-27T18:34:31.706ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5972024-11-27T18:34:31.708ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
5982024-11-27T18:34:31.708ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 134.554515ms iteration = 1 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
5992024-11-27T18:34:31.711ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6002024-11-27T18:34:31.711ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6012024-11-27T18:34:31.711ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6022024-11-27T18:34:31.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6032024-11-27T18:34:31.716ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
6042024-11-27T18:34:31.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
6052024-11-27T18:34:31.719ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_internal dns_group = internal error = Internal Error: expected exactly one latest version for DNS group Internal, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
6062024-11-27T18:34:31.719ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 145.898403ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group Internal, found 0"}
6072024-11-27T18:34:31.724ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6082024-11-27T18:34:31.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6092024-11-27T18:34:31.726ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6102024-11-27T18:34:31.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6112024-11-27T18:34:31.730ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6122024-11-27T18:34:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6132024-11-27T18:34:31.734ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6142024-11-27T18:34:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6152024-11-27T18:34:31.741ZWARNnexus (BackgroundTasks): failed to read Silo/DNS/TLS configuration background_task = external_endpoints error = Internal Error: expected at least one external DNS zone file = nexus/src/app/background/tasks/external_endpoints.rs:48
6162024-11-27T18:34:31.741ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 167.837138ms iteration = 1 status = {"error":"failed to read Silo/DNS/TLS configuration: Internal Error: expected at least one external DNS zone"}
6172024-11-27T18:34:31.744ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6182024-11-27T18:34:31.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6192024-11-27T18:34:31.747ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6202024-11-27T18:34:31.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6212024-11-27T18:34:31.748ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 174.978653ms iteration = 1 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6222024-11-27T18:34:31.749ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6232024-11-27T18:34:31.753ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6242024-11-27T18:34:31.753ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6252024-11-27T18:34:31.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6262024-11-27T18:34:31.757ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6272024-11-27T18:34:31.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6282024-11-27T18:34:31.759ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_external dns_group = external error = Internal Error: expected exactly one latest version for DNS group External, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
6292024-11-27T18:34:31.759ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 185.56242ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group External, found 0"}
6302024-11-27T18:34:31.759ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 185.761753ms iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6312024-11-27T18:34:31.760ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6322024-11-27T18:34:31.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6332024-11-27T18:34:31.761ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6342024-11-27T18:34:31.761ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 187.643131ms iteration = 1 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
6352024-11-27T18:34:31.761ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 187.687851ms iteration = 1 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6362024-11-27T18:34:31.762ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6372024-11-27T18:34:31.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6382024-11-27T18:34:31.765ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6392024-11-27T18:34:31.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6402024-11-27T18:34:31.767ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6412024-11-27T18:34:31.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6422024-11-27T18:34:31.769ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6432024-11-27T18:34:31.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6442024-11-27T18:34:31.775ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6452024-11-27T18:34:31.775ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
6462024-11-27T18:34:31.775ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 201.891461ms iteration = 1 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
6472024-11-27T18:34:31.778ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
6482024-11-27T18:34:31.778ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
6492024-11-27T18:34:31.778ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 204.282067ms iteration = 1 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
6502024-11-27T18:34:31.780ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6512024-11-27T18:34:31.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6522024-11-27T18:34:31.785ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
6532024-11-27T18:34:31.785ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
6542024-11-27T18:34:31.785ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
6552024-11-27T18:34:31.786ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "62e773b7-b4c1-4d8c-a88c-ae53f288f641", "content-length": "476", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
6562024-11-27T18:34:31.786ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
6572024-11-27T18:34:31.786ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4fb6b53-d380-415e-84e0-fd1b11e8a868", "content-length": "734", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
6582024-11-27T18:34:31.788ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
6592024-11-27T18:34:31.788ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc866dd7-e09e-4863-9bce-9e1ab0423a55", "content-length": "111", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
6602024-11-27T18:34:31.788ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
6612024-11-27T18:34:31.789ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "14ad9be6-65fd-4e1b-bd60-1cf4f9fecf90", "content-length": "111", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
6622024-11-27T18:34:31.789ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
6632024-11-27T18:34:31.789ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "622b072b-bcc9-423c-9c6d-179ab5f478a1", "content-length": "167", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
6642024-11-27T18:34:31.789ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
6652024-11-27T18:34:31.789ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "25d98db5-3f89-49fc-a4ec-947919a03831", "content-length": "167", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
6662024-11-27T18:34:31.789ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
6672024-11-27T18:34:31.790ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "59da6256-3984-4db4-9354-0762f3c5eb50", "content-length": "175", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
6682024-11-27T18:34:31.790ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
6692024-11-27T18:34:31.790ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc208a5d-9961-42e9-9f0a-42df93bf92a4", "content-length": "175", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
6702024-11-27T18:34:31.790ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
6712024-11-27T18:34:31.790ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b5177f1-0c0f-4e94-8bae-25ab33ac5b1a", "content-length": "702", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
6722024-11-27T18:34:31.790ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6732024-11-27T18:34:31.790ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef69f523-364f-4214-aa63-674e7786705f", "content-length": "727", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
6742024-11-27T18:34:31.790ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6752024-11-27T18:34:31.790ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "85db1754-7715-46d8-8c1b-92068d0c9829", "content-length": "729", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
6762024-11-27T18:34:31.790ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6772024-11-27T18:34:31.791ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "965ad356-6bdd-47f6-8956-ced9506b2f15", "content-length": "728", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
6782024-11-27T18:34:31.791ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
6792024-11-27T18:34:31.791ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ac67510-14fc-4346-b782-236b722bda45", "content-length": "722", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
6802024-11-27T18:34:31.791ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
6812024-11-27T18:34:31.791ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b84c5501-bdf4-4d25-b303-599a048156e2", "content-length": "109", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
6822024-11-27T18:34:31.791ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
6832024-11-27T18:34:31.791ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac1a06c2-af83-4598-b766-b31c313eae7d", "content-length": "109", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
6842024-11-27T18:34:31.791ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
6852024-11-27T18:34:31.792ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "66bcbf41-2a74-46ae-8b92-2b1ccb7bc683", "content-length": "169", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
6862024-11-27T18:34:31.792ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
6872024-11-27T18:34:31.792ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f95e7d08-8d8a-40eb-9c30-c97cdb81b674", "content-length": "169", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
6882024-11-27T18:34:31.792ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
6892024-11-27T18:34:31.792ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe7dd9e3-b853-4683-95df-35e80b74fff2", "content-length": "178", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
6902024-11-27T18:34:31.792ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
6912024-11-27T18:34:31.793ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2188090-a133-4e15-abda-a3c2a651430f", "content-length": "178", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
6922024-11-27T18:34:31.793ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
6932024-11-27T18:34:31.793ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f57b902-e62d-4995-82aa-5d73a02c687c", "content-length": "702", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
6942024-11-27T18:34:31.793ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
6952024-11-27T18:34:31.793ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "49d1520e-18cb-4f7a-a67f-f07efec348b5", "content-length": "727", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
6962024-11-27T18:34:31.793ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
6972024-11-27T18:34:31.793ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e3698d5-01e5-4ab9-a5e6-d8a09d361b9d", "content-length": "729", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
6982024-11-27T18:34:31.793ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
6992024-11-27T18:34:31.793ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca6a5a03-4bba-4b66-aec9-1cc85391cb64", "content-length": "728", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
7002024-11-27T18:34:31.793ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7012024-11-27T18:34:31.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7022024-11-27T18:34:31.795ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 221.421761ms iteration = 1 status = {}
7032024-11-27T18:34:31.795ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7042024-11-27T18:34:31.796ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 222.478167ms iteration = 1 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
7052024-11-27T18:34:31.797ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7062024-11-27T18:34:31.797ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7072024-11-27T18:34:31.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7082024-11-27T18:34:31.798ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7092024-11-27T18:34:31.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7102024-11-27T18:34:31.799ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7112024-11-27T18:34:31.800ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7122024-11-27T18:34:31.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7132024-11-27T18:34:31.801ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7142024-11-27T18:34:31.801ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7152024-11-27T18:34:31.802ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7162024-11-27T18:34:31.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7172024-11-27T18:34:31.805ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
7182024-11-27T18:34:31.805ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 231.946837ms iteration = 1 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
7192024-11-27T18:34:31.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
7202024-11-27T18:34:31.805ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7212024-11-27T18:34:31.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7222024-11-27T18:34:31.807ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7232024-11-27T18:34:31.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7242024-11-27T18:34:31.809ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7252024-11-27T18:34:31.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7262024-11-27T18:34:31.811ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7272024-11-27T18:34:31.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7282024-11-27T18:34:31.814ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7292024-11-27T18:34:31.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7302024-11-27T18:34:31.819ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
7312024-11-27T18:34:31.819ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7322024-11-27T18:34:31.820ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c84f863-5a9c-495c-a13a-26068ad7438b", "content-length": "26", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
7332024-11-27T18:34:31.820ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7342024-11-27T18:34:31.821ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7352024-11-27T18:34:31.837ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
7362024-11-27T18:34:31.837ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3ee90f5-3e36-4b62-91b6-b28428d87e5a", "content-length": "1", "date": "Wed, 27 Nov 2024 18:34:31 GMT"} })
7372024-11-27T18:34:31.838ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7382024-11-27T18:34:31.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7392024-11-27T18:34:31.851ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 277.914938ms iteration = 1 status = null
7402024-11-27T18:34:31.852ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7412024-11-27T18:34:31.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7422024-11-27T18:34:31.854ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7432024-11-27T18:34:31.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7442024-11-27T18:34:31.856ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7452024-11-27T18:34:31.862ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 288.181411ms iteration = 1 status = {}
7462024-11-27T18:34:31.862ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
7472024-11-27T18:34:31.862ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7482024-11-27T18:34:31.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7492024-11-27T18:34:31.864ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7502024-11-27T18:34:31.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7512024-11-27T18:34:31.866ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7522024-11-27T18:34:31.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7532024-11-27T18:34:31.867ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7542024-11-27T18:34:31.871ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
7552024-11-27T18:34:31.871ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7562024-11-27T18:34:31.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7572024-11-27T18:34:31.882ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
7582024-11-27T18:34:31.882ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
7592024-11-27T18:34:31.882ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
7602024-11-27T18:34:31.884ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7612024-11-27T18:34:31.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7622024-11-27T18:34:31.886ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7632024-11-27T18:34:31.886ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7642024-11-27T18:34:31.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7652024-11-27T18:34:31.888ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
7662024-11-27T18:34:31.888ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7672024-11-27T18:34:31.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7682024-11-27T18:34:31.888ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7692024-11-27T18:34:31.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7702024-11-27T18:34:31.890ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7712024-11-27T18:34:31.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7722024-11-27T18:34:31.892ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7732024-11-27T18:34:31.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7742024-11-27T18:34:31.895ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7752024-11-27T18:34:31.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7762024-11-27T18:34:31.896ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7772024-11-27T18:34:31.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7782024-11-27T18:34:31.898ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7792024-11-27T18:34:31.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7802024-11-27T18:34:31.899ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7812024-11-27T18:34:31.899ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7822024-11-27T18:34:31.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7832024-11-27T18:34:31.900ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7842024-11-27T18:34:31.903ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7852024-11-27T18:34:31.903ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7862024-11-27T18:34:31.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7872024-11-27T18:34:31.903ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
7882024-11-27T18:34:31.904ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7892024-11-27T18:34:31.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7902024-11-27T18:34:31.904ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7912024-11-27T18:34:31.905ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7922024-11-27T18:34:31.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7932024-11-27T18:34:31.906ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7942024-11-27T18:34:31.906ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7952024-11-27T18:34:31.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7962024-11-27T18:34:31.907ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7972024-11-27T18:34:31.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7982024-11-27T18:34:31.909ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7992024-11-27T18:34:31.912ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
8002024-11-27T18:34:31.912ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8012024-11-27T18:34:31.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8022024-11-27T18:34:31.919ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
8032024-11-27T18:34:31.920ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8042024-11-27T18:34:31.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8052024-11-27T18:34:31.921ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8062024-11-27T18:34:31.923ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
8072024-11-27T18:34:31.923ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8082024-11-27T18:34:31.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8092024-11-27T18:34:31.938ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
8102024-11-27T18:34:31.938ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = []
8112024-11-27T18:34:31.938ZDEBGnexus (service-firewall-rule-progator): resolved 0 rules for sleds background_task = service_firewall_rule_propagation
8122024-11-27T18:34:31.973ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 399.123925ms iteration = 1 status = {}
8132024-11-27T18:34:32.125ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = []
8142024-11-27T18:34:32.125ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
8152024-11-27T18:34:32.125ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 0 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
8162024-11-27T18:34:32.125ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 548.747033ms
8172024-11-27T18:34:32.125ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 551.24216ms iteration = 1 status = {}
8182024-11-27T18:34:32.237ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = b845cb2a-c1b0-4e85-86db-5319430db8f0 file = nexus/db-queries/src/db/datastore/inventory.rs:1006
8192024-11-27T18:34:32.237ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = b845cb2a-c1b0-4e85-86db-5319430db8f0 time_started = 2024-11-27 18:34:31.782512 UTC
8202024-11-27T18:34:32.237ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 663.9292ms iteration = 1 status = {"collection_id":"b845cb2a-c1b0-4e85-86db-5319430db8f0","time_done":"2024-11-27 18:34:31.882546 UTC","time_started":"2024-11-27 18:34:31.782512 UTC"}
8212024-11-27T18:34:32.237ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 2 reason = Dependency
8222024-11-27T18:34:32.237ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8232024-11-27T18:34:32.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8242024-11-27T18:34:32.239ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8252024-11-27T18:34:32.241ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
8262024-11-27T18:34:32.241ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8272024-11-27T18:34:32.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8282024-11-27T18:34:32.243ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:80 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
8292024-11-27T18:34:32.243ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 5.805286ms iteration = 2 status = {"error":"rack not yet initialized: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2"}
8302024-11-27T18:34:32.411ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8312024-11-27T18:34:32.411ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8322024-11-27T18:34:32.413ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8332024-11-27T18:34:32.414ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8342024-11-27T18:34:32.415ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8352024-11-27T18:34:32.418ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, lookup_type: ById(62a8af4d-fc95-42f9-a9e4-071aa14ffdb2) } result = Ok(())
8362024-11-27T18:34:32.418ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, time_created: 2024-11-27T18:34:31.258251Z, time_modified: 2024-11-27T18:34:31.258251Z }, initialized: false, tuf_base_url: None, rack_subnet: None } file = nexus/src/app/rack.rs:768
8372024-11-27T18:34:32.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8382024-11-27T18:34:32.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8392024-11-27T18:34:32.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8402024-11-27T18:34:32.462ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 resource = Fleet result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8412024-11-27T18:34:32.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8422024-11-27T18:34:32.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8432024-11-27T18:34:32.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8442024-11-27T18:34:32.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8452024-11-27T18:34:32.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8462024-11-27T18:34:32.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8472024-11-27T18:34:32.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8482024-11-27T18:34:32.498ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 resource = Rack { parent: Fleet, key: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, lookup_type: ById(62a8af4d-fc95-42f9-a9e4-071aa14ffdb2) } result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8492024-11-27T18:34:32.498ZDEBGnexus (dropshot_internal): updating rack subnet for rack 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8502024-11-27T18:34:32.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8512024-11-27T18:34:32.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8522024-11-27T18:34:32.508ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8532024-11-27T18:34:32.540ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8542024-11-27T18:34:32.541ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "0301c681-f7a0-41e3-8f77-09724bc56da6", "content-length": "24", "date": "Wed, 27 Nov 2024 18:34:32 GMT"} }) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8552024-11-27T18:34:32.544ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8562024-11-27T18:34:32.544ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8572024-11-27T18:34:32.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8582024-11-27T18:34:32.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8592024-11-27T18:34:32.557ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8602024-11-27T18:34:32.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8612024-11-27T18:34:32.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8622024-11-27T18:34:32.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8632024-11-27T18:34:32.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8642024-11-27T18:34:32.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8652024-11-27T18:34:32.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8662024-11-27T18:34:32.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8672024-11-27T18:34:32.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8682024-11-27T18:34:32.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8692024-11-27T18:34:32.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8702024-11-27T18:34:32.785ZDEBGnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8712024-11-27T18:34:32.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8722024-11-27T18:34:32.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8732024-11-27T18:34:32.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8742024-11-27T18:34:32.793ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 resource = Fleet result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8752024-11-27T18:34:32.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8762024-11-27T18:34:32.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8772024-11-27T18:34:32.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8782024-11-27T18:34:32.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8792024-11-27T18:34:32.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8802024-11-27T18:34:32.798ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 resource = IpPool { parent: Fleet, key: 1dc75498-40ed-4434-8e48-1c8a898cc19d, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8812024-11-27T18:34:32.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8822024-11-27T18:34:32.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8832024-11-27T18:34:32.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8842024-11-27T18:34:32.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8852024-11-27T18:34:32.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8862024-11-27T18:34:32.803ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 resource = IpPool { parent: Fleet, key: 1dc75498-40ed-4434-8e48-1c8a898cc19d, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8872024-11-27T18:34:32.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8882024-11-27T18:34:32.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8892024-11-27T18:34:32.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8902024-11-27T18:34:32.829ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 resource = BlueprintConfig result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8912024-11-27T18:34:32.984ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = 4ce244bc-1034-4855-877d-76a08bc15b71 file = nexus/db-queries/src/db/datastore/deployment.rs:451 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8922024-11-27T18:34:32.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8932024-11-27T18:34:32.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8942024-11-27T18:34:32.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8952024-11-27T18:34:32.988ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 resource = BlueprintConfig result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8962024-11-27T18:34:33.008ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8972024-11-27T18:34:33.008ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8982024-11-27T18:34:33.008ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
8992024-11-27T18:34:33.008ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9002024-11-27T18:34:33.008ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9012024-11-27T18:34:33.008ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9022024-11-27T18:34:33.008ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9032024-11-27T18:34:33.008ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9042024-11-27T18:34:33.108ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9052024-11-27T18:34:33.130ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9062024-11-27T18:34:33.150ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9072024-11-27T18:34:33.175ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9082024-11-27T18:34:33.196ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9092024-11-27T18:34:33.196ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9102024-11-27T18:34:33.196ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9112024-11-27T18:34:33.196ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9122024-11-27T18:34:33.196ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9132024-11-27T18:34:33.196ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9142024-11-27T18:34:33.196ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9152024-11-27T18:34:33.196ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9162024-11-27T18:34:33.196ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9172024-11-27T18:34:33.196ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9182024-11-27T18:34:33.196ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9192024-11-27T18:34:33.196ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9202024-11-27T18:34:33.196ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9212024-11-27T18:34:33.196ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9222024-11-27T18:34:33.196ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9232024-11-27T18:34:33.226ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9242024-11-27T18:34:33.226ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:808 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9252024-11-27T18:34:33.226ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: eec921ac-ae8e-4442-bda5-2bbbfad7ba52 (physical_disk), time_created: 2024-11-27T18:34:32.462314532Z, time_modified: 2024-11-27T18:34:32.462314532Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: b844cfb5-ff43-41f6-a61d-f7949f48466b, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9262024-11-27T18:34:33.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9272024-11-27T18:34:33.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9282024-11-27T18:34:33.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9292024-11-27T18:34:33.230ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 resource = Fleet result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9302024-11-27T18:34:33.249ZERROnexus (dropshot_internal): Failed to upsert physical disk actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true err = Custom transaction error: Object (of type ById(b844cfb5-ff43-41f6-a61d-f7949f48466b)) not found: sled file = nexus/db-queries/src/db/datastore/rack.rs:815 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9312024-11-27T18:34:33.257ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "b844cfb5-ff43-41f6-a61d-f7949f48466b" error_message_internal = not found: sled with id "b844cfb5-ff43-41f6-a61d-f7949f48466b" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 798697 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 57231760-fa4e-4857-a03c-a18d7b9c7401 response_code = 404 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9322024-11-27T18:34:34.419ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9332024-11-27T18:34:34.419ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9342024-11-27T18:34:34.421ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9352024-11-27T18:34:34.421ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9362024-11-27T18:34:34.423ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9372024-11-27T18:34:34.425ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, lookup_type: ById(62a8af4d-fc95-42f9-a9e4-071aa14ffdb2) } result = Ok(())
9382024-11-27T18:34:34.425ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, time_created: 2024-11-27T18:34:31.258251Z, time_modified: 2024-11-27T18:34:31.258251Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9392024-11-27T18:34:34.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9402024-11-27T18:34:34.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9412024-11-27T18:34:34.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9422024-11-27T18:34:34.483ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 resource = Fleet result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9432024-11-27T18:34:34.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9442024-11-27T18:34:34.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9452024-11-27T18:34:34.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9462024-11-27T18:34:34.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9472024-11-27T18:34:34.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9482024-11-27T18:34:34.487ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9492024-11-27T18:34:34.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9502024-11-27T18:34:34.491ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 resource = Rack { parent: Fleet, key: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, lookup_type: ById(62a8af4d-fc95-42f9-a9e4-071aa14ffdb2) } result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9512024-11-27T18:34:34.491ZDEBGnexus (dropshot_internal): updating rack subnet for rack 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9522024-11-27T18:34:34.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9532024-11-27T18:34:34.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9542024-11-27T18:34:34.500ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9552024-11-27T18:34:34.529ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9562024-11-27T18:34:34.530ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c29b575-b769-4b23-8b17-cf9aec369c49", "content-length": "24", "date": "Wed, 27 Nov 2024 18:34:34 GMT"} }) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9572024-11-27T18:34:34.530ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9582024-11-27T18:34:34.530ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9592024-11-27T18:34:34.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9602024-11-27T18:34:34.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9612024-11-27T18:34:34.558ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9622024-11-27T18:34:34.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9632024-11-27T18:34:34.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9642024-11-27T18:34:34.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9652024-11-27T18:34:34.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9662024-11-27T18:34:34.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9672024-11-27T18:34:34.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9682024-11-27T18:34:34.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9692024-11-27T18:34:34.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9702024-11-27T18:34:34.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9712024-11-27T18:34:34.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9722024-11-27T18:34:34.603ZDEBGnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9732024-11-27T18:34:34.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9742024-11-27T18:34:34.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9752024-11-27T18:34:34.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9762024-11-27T18:34:34.607ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 resource = Fleet result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9772024-11-27T18:34:34.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9782024-11-27T18:34:34.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9792024-11-27T18:34:34.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9802024-11-27T18:34:34.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9812024-11-27T18:34:34.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9822024-11-27T18:34:34.614ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 resource = IpPool { parent: Fleet, key: 1dc75498-40ed-4434-8e48-1c8a898cc19d, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9832024-11-27T18:34:34.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9842024-11-27T18:34:34.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9852024-11-27T18:34:34.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9862024-11-27T18:34:34.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9872024-11-27T18:34:34.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9882024-11-27T18:34:34.621ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 resource = IpPool { parent: Fleet, key: 1dc75498-40ed-4434-8e48-1c8a898cc19d, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9892024-11-27T18:34:34.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9902024-11-27T18:34:34.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9912024-11-27T18:34:34.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9922024-11-27T18:34:34.640ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 resource = BlueprintConfig result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9932024-11-27T18:34:34.777ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = 4ce244bc-1034-4855-877d-76a08bc15b71 file = nexus/db-queries/src/db/datastore/deployment.rs:451 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9942024-11-27T18:34:34.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9952024-11-27T18:34:34.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9962024-11-27T18:34:34.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9972024-11-27T18:34:34.780ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 resource = BlueprintConfig result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9982024-11-27T18:34:34.791ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
9992024-11-27T18:34:34.791ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10002024-11-27T18:34:34.791ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10012024-11-27T18:34:34.791ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10022024-11-27T18:34:34.791ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10032024-11-27T18:34:34.791ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10042024-11-27T18:34:34.791ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10052024-11-27T18:34:34.791ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10062024-11-27T18:34:34.863ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10072024-11-27T18:34:34.883ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10082024-11-27T18:34:34.917ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10092024-11-27T18:34:34.939ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10102024-11-27T18:34:34.961ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10112024-11-27T18:34:34.961ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10122024-11-27T18:34:34.961ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10132024-11-27T18:34:34.961ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10142024-11-27T18:34:34.961ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10152024-11-27T18:34:34.961ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10162024-11-27T18:34:34.961ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10172024-11-27T18:34:34.961ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10182024-11-27T18:34:34.961ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10192024-11-27T18:34:34.961ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10202024-11-27T18:34:34.961ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10212024-11-27T18:34:34.961ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10222024-11-27T18:34:34.961ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10232024-11-27T18:34:34.961ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10242024-11-27T18:34:34.961ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10252024-11-27T18:34:34.981ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10262024-11-27T18:34:34.981ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:808 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10272024-11-27T18:34:34.981ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: eec921ac-ae8e-4442-bda5-2bbbfad7ba52 (physical_disk), time_created: 2024-11-27T18:34:34.483631103Z, time_modified: 2024-11-27T18:34:34.483631103Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: b844cfb5-ff43-41f6-a61d-f7949f48466b, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10282024-11-27T18:34:34.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10292024-11-27T18:34:34.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10302024-11-27T18:34:34.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10312024-11-27T18:34:34.985ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 resource = Fleet result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10322024-11-27T18:34:35.013ZERROnexus (dropshot_internal): Failed to upsert physical disk actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true err = Custom transaction error: Object (of type ById(b844cfb5-ff43-41f6-a61d-f7949f48466b)) not found: sled file = nexus/db-queries/src/db/datastore/rack.rs:815 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10332024-11-27T18:34:35.016ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "b844cfb5-ff43-41f6-a61d-f7949f48466b" error_message_internal = not found: sled with id "b844cfb5-ff43-41f6-a61d-f7949f48466b" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 536735 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = a5b32664-8479-4db3-bff2-4f2a82b00cc4 response_code = 404 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10342024-11-27T18:34:36.013ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:40772
10352024-11-27T18:34:36.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40772 req_id = f8476905-afdf-4bec-be11-cebca7f89821 roles = RoleSet { roles: {} } uri = /metrics/producers
10362024-11-27T18:34:36.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40772 req_id = f8476905-afdf-4bec-be11-cebca7f89821 resource = Database result = Ok(()) uri = /metrics/producers
10372024-11-27T18:34:36.066ZINFOnexus: assigned collector to new producer collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:76 producer_id = 89a52276-2829-4963-a094-8143be2c1bad
10382024-11-27T18:34:36.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53384 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40772 req_id = f8476905-afdf-4bec-be11-cebca7f89821 response_code = 201 uri = /metrics/producers
10392024-11-27T18:34:36.426ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10402024-11-27T18:34:36.426ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10412024-11-27T18:34:36.428ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10422024-11-27T18:34:36.428ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10432024-11-27T18:34:36.429ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10442024-11-27T18:34:36.432ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, lookup_type: ById(62a8af4d-fc95-42f9-a9e4-071aa14ffdb2) } result = Ok(())
10452024-11-27T18:34:36.432ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, time_created: 2024-11-27T18:34:31.258251Z, time_modified: 2024-11-27T18:34:31.258251Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
10462024-11-27T18:34:37.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10472024-11-27T18:34:37.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10482024-11-27T18:34:37.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10492024-11-27T18:34:37.338ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 resource = Fleet result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10502024-11-27T18:34:37.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10512024-11-27T18:34:37.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10522024-11-27T18:34:37.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10532024-11-27T18:34:37.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10542024-11-27T18:34:37.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10552024-11-27T18:34:37.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10562024-11-27T18:34:37.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10572024-11-27T18:34:37.361ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 resource = Rack { parent: Fleet, key: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, lookup_type: ById(62a8af4d-fc95-42f9-a9e4-071aa14ffdb2) } result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10582024-11-27T18:34:37.361ZDEBGnexus (dropshot_internal): updating rack subnet for rack 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10592024-11-27T18:34:37.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10602024-11-27T18:34:37.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10612024-11-27T18:34:37.367ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10622024-11-27T18:34:37.397ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10632024-11-27T18:34:37.397ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "848685a3-541e-49dc-9066-dc097ce08cc6", "content-length": "24", "date": "Wed, 27 Nov 2024 18:34:37 GMT"} }) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10642024-11-27T18:34:37.397ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10652024-11-27T18:34:37.397ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10662024-11-27T18:34:37.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10672024-11-27T18:34:37.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10682024-11-27T18:34:37.420ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10692024-11-27T18:34:37.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10702024-11-27T18:34:37.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10712024-11-27T18:34:37.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10722024-11-27T18:34:37.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10732024-11-27T18:34:37.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10742024-11-27T18:34:37.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10752024-11-27T18:34:37.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10762024-11-27T18:34:37.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10772024-11-27T18:34:37.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10782024-11-27T18:34:37.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10792024-11-27T18:34:37.480ZDEBGnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10802024-11-27T18:34:37.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10812024-11-27T18:34:37.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10822024-11-27T18:34:37.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10832024-11-27T18:34:37.484ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 resource = Fleet result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10842024-11-27T18:34:37.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10852024-11-27T18:34:37.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10862024-11-27T18:34:37.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10872024-11-27T18:34:37.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10882024-11-27T18:34:37.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10892024-11-27T18:34:37.490ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 resource = IpPool { parent: Fleet, key: 1dc75498-40ed-4434-8e48-1c8a898cc19d, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10902024-11-27T18:34:37.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10912024-11-27T18:34:37.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10922024-11-27T18:34:37.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10932024-11-27T18:34:37.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10942024-11-27T18:34:37.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10952024-11-27T18:34:37.495ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 resource = IpPool { parent: Fleet, key: 1dc75498-40ed-4434-8e48-1c8a898cc19d, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10962024-11-27T18:34:37.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10972024-11-27T18:34:37.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10982024-11-27T18:34:37.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
10992024-11-27T18:34:37.512ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 resource = BlueprintConfig result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11002024-11-27T18:34:37.637ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = 4ce244bc-1034-4855-877d-76a08bc15b71 file = nexus/db-queries/src/db/datastore/deployment.rs:451 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11012024-11-27T18:34:37.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11022024-11-27T18:34:37.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11032024-11-27T18:34:37.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11042024-11-27T18:34:37.640ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 resource = BlueprintConfig result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11052024-11-27T18:34:37.646ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11062024-11-27T18:34:37.646ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11072024-11-27T18:34:37.646ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11082024-11-27T18:34:37.646ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11092024-11-27T18:34:37.646ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11102024-11-27T18:34:37.646ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11112024-11-27T18:34:37.646ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11122024-11-27T18:34:37.646ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11132024-11-27T18:34:37.742ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11142024-11-27T18:34:37.764ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11152024-11-27T18:34:37.780ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11162024-11-27T18:34:37.795ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11172024-11-27T18:34:37.809ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11182024-11-27T18:34:37.809ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11192024-11-27T18:34:37.809ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11202024-11-27T18:34:37.809ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11212024-11-27T18:34:37.809ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11222024-11-27T18:34:37.809ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11232024-11-27T18:34:37.809ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11242024-11-27T18:34:37.809ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11252024-11-27T18:34:37.809ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11262024-11-27T18:34:37.809ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11272024-11-27T18:34:37.809ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11282024-11-27T18:34:37.809ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11292024-11-27T18:34:37.809ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11302024-11-27T18:34:37.809ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11312024-11-27T18:34:37.809ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11322024-11-27T18:34:37.824ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11332024-11-27T18:34:37.824ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:808 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11342024-11-27T18:34:37.824ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: eec921ac-ae8e-4442-bda5-2bbbfad7ba52 (physical_disk), time_created: 2024-11-27T18:34:37.338694600Z, time_modified: 2024-11-27T18:34:37.338694600Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: b844cfb5-ff43-41f6-a61d-f7949f48466b, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11352024-11-27T18:34:37.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11362024-11-27T18:34:37.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11372024-11-27T18:34:37.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11382024-11-27T18:34:37.833ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 resource = Fleet result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11392024-11-27T18:34:37.857ZERROnexus (dropshot_internal): Failed to upsert physical disk actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true err = Custom transaction error: Object (of type ById(b844cfb5-ff43-41f6-a61d-f7949f48466b)) not found: sled file = nexus/db-queries/src/db/datastore/rack.rs:815 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11402024-11-27T18:34:37.860ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "b844cfb5-ff43-41f6-a61d-f7949f48466b" error_message_internal = not found: sled with id "b844cfb5-ff43-41f6-a61d-f7949f48466b" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 525505 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = d71a69ce-87d6-4bbb-8584-cf50fac4ec62 response_code = 404 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11412024-11-27T18:34:38.433ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11422024-11-27T18:34:38.433ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11432024-11-27T18:34:38.434ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11442024-11-27T18:34:38.434ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11452024-11-27T18:34:38.436ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11462024-11-27T18:34:38.438ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, lookup_type: ById(62a8af4d-fc95-42f9-a9e4-071aa14ffdb2) } result = Ok(())
11472024-11-27T18:34:38.438ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, time_created: 2024-11-27T18:34:31.258251Z, time_modified: 2024-11-27T18:34:31.258251Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
11482024-11-27T18:34:39.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11492024-11-27T18:34:39.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11502024-11-27T18:34:39.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11512024-11-27T18:34:39.403ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 resource = Fleet result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11522024-11-27T18:34:39.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11532024-11-27T18:34:39.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11542024-11-27T18:34:39.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11552024-11-27T18:34:39.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11562024-11-27T18:34:39.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11572024-11-27T18:34:39.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11582024-11-27T18:34:39.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11592024-11-27T18:34:39.438ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 resource = Rack { parent: Fleet, key: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, lookup_type: ById(62a8af4d-fc95-42f9-a9e4-071aa14ffdb2) } result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11602024-11-27T18:34:39.438ZDEBGnexus (dropshot_internal): updating rack subnet for rack 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11612024-11-27T18:34:39.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11622024-11-27T18:34:39.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11632024-11-27T18:34:39.451ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11642024-11-27T18:34:39.482ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11652024-11-27T18:34:39.482ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "3210bfce-ef00-4264-92cc-eca9618afbf2", "content-length": "24", "date": "Wed, 27 Nov 2024 18:34:39 GMT"} }) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11662024-11-27T18:34:39.482ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11672024-11-27T18:34:39.482ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11682024-11-27T18:34:39.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11692024-11-27T18:34:39.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11702024-11-27T18:34:39.510ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11712024-11-27T18:34:39.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11722024-11-27T18:34:39.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11732024-11-27T18:34:39.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11742024-11-27T18:34:39.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11752024-11-27T18:34:39.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11762024-11-27T18:34:39.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11772024-11-27T18:34:39.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11782024-11-27T18:34:39.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11792024-11-27T18:34:39.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11802024-11-27T18:34:39.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11812024-11-27T18:34:39.550ZDEBGnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11822024-11-27T18:34:39.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11832024-11-27T18:34:39.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11842024-11-27T18:34:39.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11852024-11-27T18:34:39.554ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 resource = Fleet result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11862024-11-27T18:34:39.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11872024-11-27T18:34:39.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11882024-11-27T18:34:39.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11892024-11-27T18:34:39.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11902024-11-27T18:34:39.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11912024-11-27T18:34:39.573ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 resource = IpPool { parent: Fleet, key: 1dc75498-40ed-4434-8e48-1c8a898cc19d, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11922024-11-27T18:34:39.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11932024-11-27T18:34:39.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11942024-11-27T18:34:39.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11952024-11-27T18:34:39.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11962024-11-27T18:34:39.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11972024-11-27T18:34:39.577ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 resource = IpPool { parent: Fleet, key: 1dc75498-40ed-4434-8e48-1c8a898cc19d, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11982024-11-27T18:34:39.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
11992024-11-27T18:34:39.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12002024-11-27T18:34:39.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12012024-11-27T18:34:39.599ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 resource = BlueprintConfig result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12022024-11-27T18:34:39.720ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = 4ce244bc-1034-4855-877d-76a08bc15b71 file = nexus/db-queries/src/db/datastore/deployment.rs:451 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12032024-11-27T18:34:39.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12042024-11-27T18:34:39.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12052024-11-27T18:34:39.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12062024-11-27T18:34:39.724ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 resource = BlueprintConfig result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12072024-11-27T18:34:39.752ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12082024-11-27T18:34:39.752ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12092024-11-27T18:34:39.752ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12102024-11-27T18:34:39.752ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12112024-11-27T18:34:39.752ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12122024-11-27T18:34:39.752ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12132024-11-27T18:34:39.752ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12142024-11-27T18:34:39.752ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12152024-11-27T18:34:39.840ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12162024-11-27T18:34:39.863ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12172024-11-27T18:34:39.886ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12182024-11-27T18:34:39.909ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12192024-11-27T18:34:39.928ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12202024-11-27T18:34:39.928ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12212024-11-27T18:34:39.928ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12222024-11-27T18:34:39.928ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12232024-11-27T18:34:39.928ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12242024-11-27T18:34:39.928ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12252024-11-27T18:34:39.928ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12262024-11-27T18:34:39.928ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12272024-11-27T18:34:39.928ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12282024-11-27T18:34:39.928ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12292024-11-27T18:34:39.928ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12302024-11-27T18:34:39.929ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12312024-11-27T18:34:39.929ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12322024-11-27T18:34:39.929ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12332024-11-27T18:34:39.929ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12342024-11-27T18:34:39.946ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:39717
12352024-11-27T18:34:39.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:39717 req_id = d6bdfd18-40bc-4e3c-9876-0a479e5bac6d roles = RoleSet { roles: {} } uri = /metrics/producers
12362024-11-27T18:34:39.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:39717 req_id = d6bdfd18-40bc-4e3c-9876-0a479e5bac6d resource = Database result = Ok(()) uri = /metrics/producers
12372024-11-27T18:34:39.950ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12382024-11-27T18:34:39.950ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:808 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12392024-11-27T18:34:39.950ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: eec921ac-ae8e-4442-bda5-2bbbfad7ba52 (physical_disk), time_created: 2024-11-27T18:34:39.403175250Z, time_modified: 2024-11-27T18:34:39.403175250Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: b844cfb5-ff43-41f6-a61d-f7949f48466b, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12402024-11-27T18:34:39.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12412024-11-27T18:34:39.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12422024-11-27T18:34:39.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12432024-11-27T18:34:39.953ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 resource = Fleet result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12442024-11-27T18:34:39.976ZERROnexus (dropshot_internal): Failed to upsert physical disk actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true err = Custom transaction error: Object (of type ById(b844cfb5-ff43-41f6-a61d-f7949f48466b)) not found: sled file = nexus/db-queries/src/db/datastore/rack.rs:815 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12452024-11-27T18:34:39.984ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "b844cfb5-ff43-41f6-a61d-f7949f48466b" error_message_internal = not found: sled with id "b844cfb5-ff43-41f6-a61d-f7949f48466b" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 585389 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = 3d87f26b-7974-4bf2-842d-e43746a1cd00 response_code = 404 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12462024-11-27T18:34:39.993ZINFOnexus: assigned collector to new producer collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:76 producer_id = b903b497-e034-4c1d-8f82-b6e6cc8f7a53
12472024-11-27T18:34:39.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44928 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:39717 req_id = d6bdfd18-40bc-4e3c-9876-0a479e5bac6d response_code = 201 uri = /metrics/producers
12482024-11-27T18:34:40.440ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12492024-11-27T18:34:40.440ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12502024-11-27T18:34:40.441ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12512024-11-27T18:34:40.442ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12522024-11-27T18:34:40.443ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12532024-11-27T18:34:40.445ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, lookup_type: ById(62a8af4d-fc95-42f9-a9e4-071aa14ffdb2) } result = Ok(())
12542024-11-27T18:34:40.445ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, time_created: 2024-11-27T18:34:31.258251Z, time_modified: 2024-11-27T18:34:31.258251Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
12552024-11-27T18:34:41.573ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 2 reason = Timeout
12562024-11-27T18:34:41.573ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12572024-11-27T18:34:41.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 2 reason = Timeout
12582024-11-27T18:34:41.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12592024-11-27T18:34:41.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12602024-11-27T18:34:41.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12612024-11-27T18:34:41.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12622024-11-27T18:34:41.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12632024-11-27T18:34:41.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12642024-11-27T18:34:41.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12652024-11-27T18:34:41.580ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
12662024-11-27T18:34:41.580ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 6.798821ms iteration = 2 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
12672024-11-27T18:34:41.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12682024-11-27T18:34:41.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12692024-11-27T18:34:41.642ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.480085ms iteration = 2 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12702024-11-27T18:34:42.446ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12712024-11-27T18:34:42.447ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12722024-11-27T18:34:42.448ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12732024-11-27T18:34:42.449ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12742024-11-27T18:34:42.450ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12752024-11-27T18:34:42.453ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, lookup_type: ById(62a8af4d-fc95-42f9-a9e4-071aa14ffdb2) } result = Ok(())
12762024-11-27T18:34:42.453ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, time_created: 2024-11-27T18:34:31.258251Z, time_modified: 2024-11-27T18:34:31.258251Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
12772024-11-27T18:34:43.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12782024-11-27T18:34:43.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12792024-11-27T18:34:43.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12802024-11-27T18:34:43.283ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Fleet result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12812024-11-27T18:34:43.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12822024-11-27T18:34:43.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12832024-11-27T18:34:43.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12842024-11-27T18:34:43.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12852024-11-27T18:34:43.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12862024-11-27T18:34:43.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12872024-11-27T18:34:43.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12882024-11-27T18:34:43.296ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Rack { parent: Fleet, key: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, lookup_type: ById(62a8af4d-fc95-42f9-a9e4-071aa14ffdb2) } result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12892024-11-27T18:34:43.296ZDEBGnexus (dropshot_internal): updating rack subnet for rack 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12902024-11-27T18:34:43.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12912024-11-27T18:34:43.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12922024-11-27T18:34:43.303ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12932024-11-27T18:34:43.334ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12942024-11-27T18:34:43.334ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "3af63074-e732-4cd3-9b6c-64254706b5a6", "content-length": "24", "date": "Wed, 27 Nov 2024 18:34:42 GMT"} }) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12952024-11-27T18:34:43.334ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12962024-11-27T18:34:43.334ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12972024-11-27T18:34:43.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12982024-11-27T18:34:43.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
12992024-11-27T18:34:43.341ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13002024-11-27T18:34:43.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13012024-11-27T18:34:43.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13022024-11-27T18:34:43.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13032024-11-27T18:34:43.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13042024-11-27T18:34:43.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13052024-11-27T18:34:43.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13062024-11-27T18:34:43.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13072024-11-27T18:34:43.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13082024-11-27T18:34:43.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13092024-11-27T18:34:43.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13102024-11-27T18:34:43.368ZDEBGnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13112024-11-27T18:34:43.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13122024-11-27T18:34:43.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13132024-11-27T18:34:43.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13142024-11-27T18:34:43.372ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Fleet result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13152024-11-27T18:34:43.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13162024-11-27T18:34:43.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13172024-11-27T18:34:43.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13182024-11-27T18:34:43.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13192024-11-27T18:34:43.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13202024-11-27T18:34:43.378ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = IpPool { parent: Fleet, key: 1dc75498-40ed-4434-8e48-1c8a898cc19d, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13212024-11-27T18:34:43.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13222024-11-27T18:34:43.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13232024-11-27T18:34:43.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13242024-11-27T18:34:43.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13252024-11-27T18:34:43.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13262024-11-27T18:34:43.383ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = IpPool { parent: Fleet, key: 1dc75498-40ed-4434-8e48-1c8a898cc19d, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13272024-11-27T18:34:43.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13282024-11-27T18:34:43.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13292024-11-27T18:34:43.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13302024-11-27T18:34:43.403ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = BlueprintConfig result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13312024-11-27T18:34:43.539ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = 4ce244bc-1034-4855-877d-76a08bc15b71 file = nexus/db-queries/src/db/datastore/deployment.rs:451 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13322024-11-27T18:34:43.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13332024-11-27T18:34:43.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13342024-11-27T18:34:43.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13352024-11-27T18:34:43.542ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = BlueprintConfig result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13362024-11-27T18:34:43.559ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13372024-11-27T18:34:43.559ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13382024-11-27T18:34:43.559ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13392024-11-27T18:34:43.559ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13402024-11-27T18:34:43.559ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13412024-11-27T18:34:43.559ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13422024-11-27T18:34:43.559ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13432024-11-27T18:34:43.559ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13442024-11-27T18:34:43.571ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:49565
13452024-11-27T18:34:43.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49565 req_id = d3668fbc-d25c-48c4-bf9e-3ae02e9cbffe roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
13462024-11-27T18:34:43.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49565 req_id = d3668fbc-d25c-48c4-bf9e-3ae02e9cbffe resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
13472024-11-27T18:34:43.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3444 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49565 req_id = d3668fbc-d25c-48c4-bf9e-3ae02e9cbffe response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
13482024-11-27T18:34:43.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49565 req_id = 70eb623c-3ee4-4e38-bfce-13ebdeb35039 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiOTAzYjQ5Ny1lMDM0LTRjMWQtOGY4Mi1iNmU2Y2M4ZjdhNTMifX0%3D
13492024-11-27T18:34:43.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49565 req_id = 70eb623c-3ee4-4e38-bfce-13ebdeb35039 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiOTAzYjQ5Ny1lMDM0LTRjMWQtOGY4Mi1iNmU2Y2M4ZjdhNTMifX0%3D
13502024-11-27T18:34:43.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2701 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49565 req_id = 70eb623c-3ee4-4e38-bfce-13ebdeb35039 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiOTAzYjQ5Ny1lMDM0LTRjMWQtOGY4Mi1iNmU2Y2M4ZjdhNTMifX0%3D
13512024-11-27T18:34:43.646ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13522024-11-27T18:34:43.674ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13532024-11-27T18:34:43.696ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13542024-11-27T18:34:43.723ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13552024-11-27T18:34:43.743ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13562024-11-27T18:34:43.743ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13572024-11-27T18:34:43.743ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13582024-11-27T18:34:43.743ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13592024-11-27T18:34:43.743ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13602024-11-27T18:34:43.743ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13612024-11-27T18:34:43.743ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13622024-11-27T18:34:43.743ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13632024-11-27T18:34:43.743ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13642024-11-27T18:34:43.743ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13652024-11-27T18:34:43.743ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13662024-11-27T18:34:43.743ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13672024-11-27T18:34:43.743ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13682024-11-27T18:34:43.743ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13692024-11-27T18:34:43.743ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13702024-11-27T18:34:43.768ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13712024-11-27T18:34:43.768ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:808 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13722024-11-27T18:34:43.768ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: eec921ac-ae8e-4442-bda5-2bbbfad7ba52 (physical_disk), time_created: 2024-11-27T18:34:43.283053397Z, time_modified: 2024-11-27T18:34:43.283053397Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: b844cfb5-ff43-41f6-a61d-f7949f48466b, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13732024-11-27T18:34:43.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13742024-11-27T18:34:43.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13752024-11-27T18:34:43.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13762024-11-27T18:34:43.771ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Fleet result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13772024-11-27T18:34:43.790ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: f6b0e65a-0b17-400f-b9d1-b6a81add629a (physical_disk), time_created: 2024-11-27T18:34:43.283053817Z, time_modified: 2024-11-27T18:34:43.283053817Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2", variant: U2, sled_id: b844cfb5-ff43-41f6-a61d-f7949f48466b, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13782024-11-27T18:34:43.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13792024-11-27T18:34:43.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13802024-11-27T18:34:43.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13812024-11-27T18:34:43.794ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Fleet result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13822024-11-27T18:34:43.798ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: b815eefb-dceb-4660-8bf3-5c21cedc840b (physical_disk), time_created: 2024-11-27T18:34:43.283053908Z, time_modified: 2024-11-27T18:34:43.283053908Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2", variant: U2, sled_id: b844cfb5-ff43-41f6-a61d-f7949f48466b, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13832024-11-27T18:34:43.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13842024-11-27T18:34:43.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13852024-11-27T18:34:43.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13862024-11-27T18:34:43.802ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Fleet result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13872024-11-27T18:34:43.807ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 9d3b9762-284e-436b-8aea-e7b34a5ad7f1 (physical_disk), time_created: 2024-11-27T18:34:43.283054017Z, time_modified: 2024-11-27T18:34:43.283054017Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2", variant: U2, sled_id: b844cfb5-ff43-41f6-a61d-f7949f48466b, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13882024-11-27T18:34:43.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13892024-11-27T18:34:43.807ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13902024-11-27T18:34:43.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13912024-11-27T18:34:43.810ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Fleet result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13922024-11-27T18:34:43.815ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 71a844bf-7595-42d2-a406-3fa0f623eeea (physical_disk), time_created: 2024-11-27T18:34:43.283054088Z, time_modified: 2024-11-27T18:34:43.283054088Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2", variant: U2, sled_id: b844cfb5-ff43-41f6-a61d-f7949f48466b, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13932024-11-27T18:34:43.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13942024-11-27T18:34:43.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13952024-11-27T18:34:43.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13962024-11-27T18:34:43.818ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Fleet result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13972024-11-27T18:34:43.822ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: f6e23111-8a71-4e0b-88ec-4eb711974fec (physical_disk), time_created: 2024-11-27T18:34:43.283054168Z, time_modified: 2024-11-27T18:34:43.283054168Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2", variant: U2, sled_id: b844cfb5-ff43-41f6-a61d-f7949f48466b, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13982024-11-27T18:34:43.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
13992024-11-27T18:34:43.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14002024-11-27T18:34:43.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14012024-11-27T18:34:43.825ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Fleet result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14022024-11-27T18:34:43.829ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: e71d5b09-1f53-4b2e-834f-de9062830293 (physical_disk), time_created: 2024-11-27T18:34:43.283054248Z, time_modified: 2024-11-27T18:34:43.283054248Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2", variant: U2, sled_id: b844cfb5-ff43-41f6-a61d-f7949f48466b, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14032024-11-27T18:34:43.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14042024-11-27T18:34:43.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14052024-11-27T18:34:43.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14062024-11-27T18:34:43.833ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Fleet result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14072024-11-27T18:34:43.837ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: d3b8dbae-333a-4f5e-b9e6-5887641e3b6c (physical_disk), time_created: 2024-11-27T18:34:43.283054317Z, time_modified: 2024-11-27T18:34:43.283054317Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2", variant: U2, sled_id: b844cfb5-ff43-41f6-a61d-f7949f48466b, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14082024-11-27T18:34:43.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14092024-11-27T18:34:43.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14102024-11-27T18:34:43.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14112024-11-27T18:34:43.840ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Fleet result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14122024-11-27T18:34:43.845ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 77717da6-134a-41cb-b858-16285173b3f2 (physical_disk), time_created: 2024-11-27T18:34:43.283054397Z, time_modified: 2024-11-27T18:34:43.283054397Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2", variant: U2, sled_id: b844cfb5-ff43-41f6-a61d-f7949f48466b, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14132024-11-27T18:34:43.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14142024-11-27T18:34:43.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14152024-11-27T18:34:43.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14162024-11-27T18:34:43.851ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Fleet result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14172024-11-27T18:34:43.856ZINFOnexus (dropshot_internal): Inserted physical disks actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:823 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14182024-11-27T18:34:43.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14192024-11-27T18:34:43.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14202024-11-27T18:34:43.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14212024-11-27T18:34:43.858ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Fleet result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14222024-11-27T18:34:43.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14232024-11-27T18:34:43.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14242024-11-27T18:34:43.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14252024-11-27T18:34:43.867ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Fleet result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14262024-11-27T18:34:43.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14272024-11-27T18:34:43.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14282024-11-27T18:34:43.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14292024-11-27T18:34:43.875ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Fleet result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14302024-11-27T18:34:43.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14312024-11-27T18:34:43.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14322024-11-27T18:34:43.881ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14332024-11-27T18:34:43.882ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Fleet result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14342024-11-27T18:34:43.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14352024-11-27T18:34:43.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14362024-11-27T18:34:43.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14372024-11-27T18:34:43.889ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Fleet result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14382024-11-27T18:34:43.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14392024-11-27T18:34:43.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14402024-11-27T18:34:43.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14412024-11-27T18:34:43.897ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Fleet result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14422024-11-27T18:34:43.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14432024-11-27T18:34:43.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14442024-11-27T18:34:43.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14452024-11-27T18:34:43.904ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Fleet result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14462024-11-27T18:34:43.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14472024-11-27T18:34:43.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14482024-11-27T18:34:43.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14492024-11-27T18:34:43.912ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Fleet result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14502024-11-27T18:34:43.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14512024-11-27T18:34:43.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14522024-11-27T18:34:43.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14532024-11-27T18:34:43.919ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Fleet result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14542024-11-27T18:34:43.926ZINFOnexus (dropshot_internal): Inserted zpools actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:835 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14552024-11-27T18:34:44.306ZINFOnexus (dropshot_internal): Inserted datasets actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:865 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14562024-11-27T18:34:44.333ZINFOnexus (dropshot_internal): Populated DNS tables for internal DNS actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:876 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14572024-11-27T18:34:44.336ZINFOnexus (dropshot_internal): Populated DNS tables for external DNS actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:885 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14582024-11-27T18:34:44.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14592024-11-27T18:34:44.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14602024-11-27T18:34:44.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14612024-11-27T18:34:44.339ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Fleet result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14622024-11-27T18:34:44.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14632024-11-27T18:34:44.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14642024-11-27T18:34:44.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14652024-11-27T18:34:44.342ZDEBGnexus (dropshot_internal): authorize result action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Fleet result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14662024-11-27T18:34:44.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14672024-11-27T18:34:44.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14682024-11-27T18:34:44.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14692024-11-27T18:34:44.376ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = DnsConfig result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14702024-11-27T18:34:44.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14712024-11-27T18:34:44.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14722024-11-27T18:34:44.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14732024-11-27T18:34:44.381ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = DnsConfig result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14742024-11-27T18:34:44.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14752024-11-27T18:34:44.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14762024-11-27T18:34:44.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14772024-11-27T18:34:44.387ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = DnsConfig result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14782024-11-27T18:34:44.399ZINFOnexus (dropshot_internal): Created recovery silo actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:451 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14792024-11-27T18:34:44.413ZINFOnexus (dropshot_internal): Created recovery user actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:467 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14802024-11-27T18:34:44.420ZINFOnexus (dropshot_internal): Created recovery user's password actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:481 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14812024-11-27T18:34:44.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14822024-11-27T18:34:44.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14832024-11-27T18:34:44.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14842024-11-27T18:34:44.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14852024-11-27T18:34:44.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14862024-11-27T18:34:44.425ZDEBGnexus (dropshot_internal): authorize result action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) } result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14872024-11-27T18:34:44.425ZDEBGnexus (dropshot_internal): Generated role assignment queries actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14882024-11-27T18:34:44.430ZINFOnexus (dropshot_internal): Granted Silo privileges actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:509 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14892024-11-27T18:34:44.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14902024-11-27T18:34:44.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14912024-11-27T18:34:44.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14922024-11-27T18:34:44.433ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Fleet result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14932024-11-27T18:34:44.453ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
14942024-11-27T18:34:44.454ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
14952024-11-27T18:34:44.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14962024-11-27T18:34:44.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14972024-11-27T18:34:44.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14982024-11-27T18:34:44.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
14992024-11-27T18:34:44.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15002024-11-27T18:34:44.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15012024-11-27T18:34:44.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15022024-11-27T18:34:44.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15032024-11-27T18:34:44.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15042024-11-27T18:34:44.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15052024-11-27T18:34:44.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15062024-11-27T18:34:44.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15072024-11-27T18:34:44.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15082024-11-27T18:34:44.471ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15092024-11-27T18:34:44.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15102024-11-27T18:34:44.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15112024-11-27T18:34:44.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15122024-11-27T18:34:44.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15132024-11-27T18:34:44.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15142024-11-27T18:34:44.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15152024-11-27T18:34:44.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15162024-11-27T18:34:44.479ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15172024-11-27T18:34:44.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15182024-11-27T18:34:44.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15192024-11-27T18:34:44.479ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
15202024-11-27T18:34:44.479ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
15212024-11-27T18:34:44.480ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15222024-11-27T18:34:44.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15232024-11-27T18:34:44.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15242024-11-27T18:34:44.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15252024-11-27T18:34:44.483ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, lookup_type: ById(62a8af4d-fc95-42f9-a9e4-071aa14ffdb2) } result = Ok(())
15262024-11-27T18:34:44.483ZINFOnexus: Rack initialized file = nexus/src/app/rack.rs:765
15272024-11-27T18:34:44.483ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15282024-11-27T18:34:44.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15292024-11-27T18:34:44.483ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15302024-11-27T18:34:44.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15312024-11-27T18:34:44.484ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15322024-11-27T18:34:44.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15332024-11-27T18:34:44.485ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15342024-11-27T18:34:44.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15352024-11-27T18:34:44.486ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15362024-11-27T18:34:44.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15372024-11-27T18:34:44.486ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15382024-11-27T18:34:44.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15392024-11-27T18:34:44.487ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15402024-11-27T18:34:44.488ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15412024-11-27T18:34:44.488ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15422024-11-27T18:34:44.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15432024-11-27T18:34:44.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15442024-11-27T18:34:44.489ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15452024-11-27T18:34:44.489ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15462024-11-27T18:34:44.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15472024-11-27T18:34:44.490ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15482024-11-27T18:34:44.490ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15492024-11-27T18:34:44.492ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15502024-11-27T18:34:44.493ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15512024-11-27T18:34:44.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15522024-11-27T18:34:44.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15532024-11-27T18:34:44.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15542024-11-27T18:34:44.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15552024-11-27T18:34:44.495ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
15562024-11-27T18:34:44.495ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15572024-11-27T18:34:44.495ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15582024-11-27T18:34:44.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15592024-11-27T18:34:44.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15602024-11-27T18:34:44.496ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15612024-11-27T18:34:44.497ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15622024-11-27T18:34:44.498ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15632024-11-27T18:34:44.498ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15642024-11-27T18:34:44.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15652024-11-27T18:34:44.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15662024-11-27T18:34:44.499ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15672024-11-27T18:34:44.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15682024-11-27T18:34:44.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15692024-11-27T18:34:44.502ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
15702024-11-27T18:34:44.502ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15712024-11-27T18:34:44.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15722024-11-27T18:34:44.502ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15732024-11-27T18:34:44.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15742024-11-27T18:34:44.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15752024-11-27T18:34:44.504ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15762024-11-27T18:34:44.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15772024-11-27T18:34:44.504ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15782024-11-27T18:34:44.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15792024-11-27T18:34:44.505ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15802024-11-27T18:34:44.506ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15812024-11-27T18:34:44.507ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15822024-11-27T18:34:44.507ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15832024-11-27T18:34:44.508ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15842024-11-27T18:34:44.508ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15852024-11-27T18:34:44.509ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15862024-11-27T18:34:44.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15872024-11-27T18:34:44.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15882024-11-27T18:34:44.509ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15892024-11-27T18:34:44.509ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15902024-11-27T18:34:44.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15912024-11-27T18:34:44.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15922024-11-27T18:34:44.511ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15932024-11-27T18:34:44.511ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15942024-11-27T18:34:44.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15952024-11-27T18:34:44.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15962024-11-27T18:34:44.512ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15972024-11-27T18:34:44.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
15982024-11-27T18:34:44.515ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
15992024-11-27T18:34:44.515ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16002024-11-27T18:34:44.515ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16012024-11-27T18:34:44.516ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16022024-11-27T18:34:44.516ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16032024-11-27T18:34:44.517ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
16042024-11-27T18:34:44.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
16052024-11-27T18:34:44.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
16062024-11-27T18:34:44.518ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16072024-11-27T18:34:44.518ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16082024-11-27T18:34:44.520ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16092024-11-27T18:34:44.520ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16102024-11-27T18:34:44.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
16112024-11-27T18:34:44.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
16122024-11-27T18:34:44.522ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16132024-11-27T18:34:44.522ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16142024-11-27T18:34:44.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
16152024-11-27T18:34:44.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
16162024-11-27T18:34:44.523ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16172024-11-27T18:34:44.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
16182024-11-27T18:34:44.524ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16192024-11-27T18:34:44.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
16202024-11-27T18:34:44.525ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16212024-11-27T18:34:44.525ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16222024-11-27T18:34:44.526ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16232024-11-27T18:34:44.529ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
16242024-11-27T18:34:44.529ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16252024-11-27T18:34:44.529ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16262024-11-27T18:34:44.531ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16272024-11-27T18:34:44.531ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16282024-11-27T18:34:44.532ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16292024-11-27T18:34:44.532ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16302024-11-27T18:34:44.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
16312024-11-27T18:34:44.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
16322024-11-27T18:34:44.533ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16332024-11-27T18:34:44.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
16342024-11-27T18:34:44.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
16352024-11-27T18:34:44.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
16362024-11-27T18:34:44.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
16372024-11-27T18:34:44.537ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
16382024-11-27T18:34:44.537ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16392024-11-27T18:34:44.537ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16402024-11-27T18:34:44.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
16412024-11-27T18:34:44.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
16422024-11-27T18:34:44.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
16432024-11-27T18:34:44.541ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16442024-11-27T18:34:44.541ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16452024-11-27T18:34:44.542ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16462024-11-27T18:34:44.542ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16472024-11-27T18:34:44.543ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16482024-11-27T18:34:44.543ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
16492024-11-27T18:34:44.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
16502024-11-27T18:34:44.543ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16512024-11-27T18:34:44.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
16522024-11-27T18:34:44.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
16532024-11-27T18:34:44.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
16542024-11-27T18:34:44.546ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16552024-11-27T18:34:44.546ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16562024-11-27T18:34:44.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
16572024-11-27T18:34:44.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
16582024-11-27T18:34:44.547ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16592024-11-27T18:34:44.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
16602024-11-27T18:34:44.548ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16612024-11-27T18:34:44.549ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16622024-11-27T18:34:44.549ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16632024-11-27T18:34:44.550ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16642024-11-27T18:34:44.551ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16652024-11-27T18:34:44.551ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
16662024-11-27T18:34:44.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
16672024-11-27T18:34:44.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
16682024-11-27T18:34:44.552ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16692024-11-27T18:34:44.555ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
16702024-11-27T18:34:44.555ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16712024-11-27T18:34:44.555ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16722024-11-27T18:34:44.556ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16732024-11-27T18:34:44.556ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16742024-11-27T18:34:44.558ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16752024-11-27T18:34:44.558ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16762024-11-27T18:34:44.559ZDEBGnexus: resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 46807e0d-b32c-46e9-ba6d-70ce0dd8f478, kind: Service { id: 923a7051-0539-4413-bab4-c2b0d3395fe2 }, name: Name("external-dns-923a7051-0539-4413-bab4-c2b0d3395fe2"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 247])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ae80547a-3043-414a-9677-e92884742152, kind: Service { id: b7585398-cabf-4150-8e11-981d1580aaf0 }, name: Name("external-dns-b7585398-cabf-4150-8e11-981d1580aaf0"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 255])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 2df4b43c-19b2-4d0e-9115-0713223786a3, kind: Service { id: fbc95b29-f83d-43ed-91f4-c64d49d2794a }, name: Name("nexus-fbc95b29-f83d-43ed-91f4-c64d49d2794a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 135])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 36b26f77-d20c-42ae-beb2-a2ba0a652ee7, kind: Service { id: 236c7b74-8315-46e3-9a37-90380a675558 }, name: Name("nexus-236c7b74-8315-46e3-9a37-90380a675558"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 105])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d3055ccd-84f0-4f36-b8e4-3dbd5b104332, kind: Service { id: 028a6b4a-281e-48cb-ac6a-4e4dfed5a146 }, name: Name("nexus-028a6b4a-281e-48cb-ac6a-4e4dfed5a146"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
16772024-11-27T18:34:44.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
16782024-11-27T18:34:44.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
16792024-11-27T18:34:44.559ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16802024-11-27T18:34:44.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
16812024-11-27T18:34:44.562ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Fleet result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
16822024-11-27T18:34:44.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 roles = RoleSet { roles: {} } uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
16832024-11-27T18:34:44.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 resource = Database result = Ok(()) uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
16842024-11-27T18:34:44.563ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
16852024-11-27T18:34:44.563ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16862024-11-27T18:34:44.563ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16872024-11-27T18:34:44.567ZDEBGnexus: Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
16882024-11-27T18:34:44.569ZDEBGnexus: resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 46807e0d-b32c-46e9-ba6d-70ce0dd8f478, kind: Service { id: 923a7051-0539-4413-bab4-c2b0d3395fe2 }, name: Name("external-dns-923a7051-0539-4413-bab4-c2b0d3395fe2"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 247])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ae80547a-3043-414a-9677-e92884742152, kind: Service { id: b7585398-cabf-4150-8e11-981d1580aaf0 }, name: Name("external-dns-b7585398-cabf-4150-8e11-981d1580aaf0"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 255])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 2df4b43c-19b2-4d0e-9115-0713223786a3, kind: Service { id: fbc95b29-f83d-43ed-91f4-c64d49d2794a }, name: Name("nexus-fbc95b29-f83d-43ed-91f4-c64d49d2794a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 135])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 36b26f77-d20c-42ae-beb2-a2ba0a652ee7, kind: Service { id: 236c7b74-8315-46e3-9a37-90380a675558 }, name: Name("nexus-236c7b74-8315-46e3-9a37-90380a675558"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 105])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d3055ccd-84f0-4f36-b8e4-3dbd5b104332, kind: Service { id: 028a6b4a-281e-48cb-ac6a-4e4dfed5a146 }, name: Name("nexus-028a6b4a-281e-48cb-ac6a-4e4dfed5a146"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
16892024-11-27T18:34:44.570ZDEBGnexus: resolved 2 rules for sleds
16902024-11-27T18:34:44.570ZDEBGnexus (InternalApi): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 2df4b43c-19b2-4d0e-9115-0713223786a3, kind: Service { id: fbc95b29-f83d-43ed-91f4-c64d49d2794a }, name: Name("nexus-fbc95b29-f83d-43ed-91f4-c64d49d2794a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 135])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 36b26f77-d20c-42ae-beb2-a2ba0a652ee7, kind: Service { id: 236c7b74-8315-46e3-9a37-90380a675558 }, name: Name("nexus-236c7b74-8315-46e3-9a37-90380a675558"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 105])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d3055ccd-84f0-4f36-b8e4-3dbd5b104332, kind: Service { id: 028a6b4a-281e-48cb-ac6a-4e4dfed5a146 }, name: Name("nexus-028a6b4a-281e-48cb-ac6a-4e4dfed5a146"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 46807e0d-b32c-46e9-ba6d-70ce0dd8f478, kind: Service { id: 923a7051-0539-4413-bab4-c2b0d3395fe2 }, name: Name("external-dns-923a7051-0539-4413-bab4-c2b0d3395fe2"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 247])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ae80547a-3043-414a-9677-e92884742152, kind: Service { id: b7585398-cabf-4150-8e11-981d1580aaf0 }, name: Name("external-dns-b7585398-cabf-4150-8e11-981d1580aaf0"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 255])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
16912024-11-27T18:34:44.570ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16922024-11-27T18:34:44.570ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16932024-11-27T18:34:44.571ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16942024-11-27T18:34:44.573ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
16952024-11-27T18:34:44.573ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16962024-11-27T18:34:44.573ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16972024-11-27T18:34:44.574ZDEBGnexus (InternalApi): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
16982024-11-27T18:34:44.574ZDEBGnexus (InternalApi): resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 46807e0d-b32c-46e9-ba6d-70ce0dd8f478, kind: Service { id: 923a7051-0539-4413-bab4-c2b0d3395fe2 }, name: Name("external-dns-923a7051-0539-4413-bab4-c2b0d3395fe2"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 247])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ae80547a-3043-414a-9677-e92884742152, kind: Service { id: b7585398-cabf-4150-8e11-981d1580aaf0 }, name: Name("external-dns-b7585398-cabf-4150-8e11-981d1580aaf0"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 255])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 2df4b43c-19b2-4d0e-9115-0713223786a3, kind: Service { id: fbc95b29-f83d-43ed-91f4-c64d49d2794a }, name: Name("nexus-fbc95b29-f83d-43ed-91f4-c64d49d2794a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 135])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 36b26f77-d20c-42ae-beb2-a2ba0a652ee7, kind: Service { id: 236c7b74-8315-46e3-9a37-90380a675558 }, name: Name("nexus-236c7b74-8315-46e3-9a37-90380a675558"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 105])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d3055ccd-84f0-4f36-b8e4-3dbd5b104332, kind: Service { id: 028a6b4a-281e-48cb-ac6a-4e4dfed5a146 }, name: Name("nexus-028a6b4a-281e-48cb-ac6a-4e4dfed5a146"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
16992024-11-27T18:34:44.574ZDEBGnexus (InternalApi): resolved 2 rules for sleds
17002024-11-27T18:34:44.590ZDEBGnexus: resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: b844cfb5-ff43-41f6-a61d-f7949f48466b, time_created: 2024-11-27T18:34:40.308972Z, time_modified: 2024-11-27T18:34:40.308972Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
17012024-11-27T18:34:44.590ZDEBGnexus: sending firewall rules to sled agents
17022024-11-27T18:34:44.591ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
17032024-11-27T18:34:44.591ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
17042024-11-27T18:34:44.594ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
17052024-11-27T18:34:44.594ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
17062024-11-27T18:34:44.595ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
17072024-11-27T18:34:44.597ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
17082024-11-27T18:34:44.619ZDEBGnexus (InternalApi): resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: b844cfb5-ff43-41f6-a61d-f7949f48466b, time_created: 2024-11-27T18:34:40.308972Z, time_modified: 2024-11-27T18:34:40.308972Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
17092024-11-27T18:34:44.619ZDEBGnexus (InternalApi): sending firewall rules to sled agents
17102024-11-27T18:34:44.619ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17112024-11-27T18:34:44.619ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17122024-11-27T18:34:44.621ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17132024-11-27T18:34:44.621ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17142024-11-27T18:34:44.622ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17152024-11-27T18:34:44.625ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
17162024-11-27T18:34:44.629ZDEBGnexus: client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17172024-11-27T18:34:44.635ZDEBGnexus: client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "67e8dad6-5c1d-4bb7-8321-0322ad04590b", "date": "Wed, 27 Nov 2024 18:34:44 GMT"} })
17182024-11-27T18:34:44.635ZINFOnexus: updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
17192024-11-27T18:34:44.635ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 2 reason = Signaled
17202024-11-27T18:34:44.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1356436 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59403 req_id = c69c40e1-3f24-471d-bb0d-52f8e810c234 response_code = 204 uri = /racks/62a8af4d-fc95-42f9-a9e4-071aa14ffdb2/initialization-complete
17212024-11-27T18:34:44.636ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 2 reason = Signaled
17222024-11-27T18:34:44.636ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 2 reason = Signaled
17232024-11-27T18:34:44.636ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
17242024-11-27T18:34:44.636ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17252024-11-27T18:34:44.636ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 2 reason = Signaled
17262024-11-27T18:34:44.636ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17272024-11-27T18:34:44.636ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 2 reason = Signaled
17282024-11-27T18:34:44.636ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 2 reason = Signaled
17292024-11-27T18:34:44.636ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
17302024-11-27T18:34:44.636ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17312024-11-27T18:34:44.636ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
17322024-11-27T18:34:44.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17332024-11-27T18:34:44.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
17342024-11-27T18:34:44.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17352024-11-27T18:34:44.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17362024-11-27T18:34:44.636ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f378a24-7578-4d72-8454-f489a3e51ffb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e203eafc-5cbd-4249-8d8a-770878ed4d6d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 2118, tv_nsec: 634978247 } })
17372024-11-27T18:34:44.636ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("923a7051-0539-4413-bab4-c2b0d3395fe2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2118, tv_nsec: 635036098 } })
17382024-11-27T18:34:44.637ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
17392024-11-27T18:34:44.637ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.138257ms iteration = 2 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
17402024-11-27T18:34:44.637ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
17412024-11-27T18:34:44.637ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.31784ms iteration = 2 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
17422024-11-27T18:34:44.637ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17432024-11-27T18:34:44.637ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17442024-11-27T18:34:44.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17452024-11-27T18:34:44.638ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17462024-11-27T18:34:44.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17472024-11-27T18:34:44.638ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17482024-11-27T18:34:44.639ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17492024-11-27T18:34:44.640ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
17502024-11-27T18:34:44.640ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17512024-11-27T18:34:44.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17522024-11-27T18:34:44.641ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
17532024-11-27T18:34:44.641ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
17542024-11-27T18:34:44.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
17552024-11-27T18:34:44.641ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17562024-11-27T18:34:44.642ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
17572024-11-27T18:34:44.644ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17582024-11-27T18:34:44.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
17592024-11-27T18:34:44.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17602024-11-27T18:34:44.646ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17612024-11-27T18:34:44.648ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
17622024-11-27T18:34:44.648ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
17632024-11-27T18:34:44.648ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
17642024-11-27T18:34:44.648ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17652024-11-27T18:34:44.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17662024-11-27T18:34:44.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
17672024-11-27T18:34:44.649ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17682024-11-27T18:34:44.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17692024-11-27T18:34:44.649ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17702024-11-27T18:34:44.652ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
17712024-11-27T18:34:44.652ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17722024-11-27T18:34:44.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17732024-11-27T18:34:44.654ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(75312a92-5758-4131-946f-9c163d729fb7, 0), (b845cb2a-c1b0-4e85-86db-5319430db8f0, 0), (13f59999-9c86-4dfc-a124-b6c19f1b3024, 0), (64504a1c-7931-4bfd-b548-bce7e883eb71, 0)] collection_id = 75312a92-5758-4131-946f-9c163d729fb7
17742024-11-27T18:34:44.654ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
17752024-11-27T18:34:44.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
17762024-11-27T18:34:44.660ZDEBGnexus (InternalApi): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17772024-11-27T18:34:44.660ZDEBGnexus (InternalApi): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "977c2e53-944f-49c8-bafa-9d41e085892f", "date": "Wed, 27 Nov 2024 18:34:44 GMT"} })
17782024-11-27T18:34:44.661ZINFOnexus (InternalApi): updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
17792024-11-27T18:34:44.661ZINFOnexus: plumbed initial IP allowlist file = nexus/src/app/allow_list.rs:161
17802024-11-27T18:34:44.674ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
17812024-11-27T18:34:44.674ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
17822024-11-27T18:34:44.674ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
17832024-11-27T18:34:44.674ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17842024-11-27T18:34:44.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17852024-11-27T18:34:44.676ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17862024-11-27T18:34:44.679ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
17872024-11-27T18:34:44.679ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17882024-11-27T18:34:44.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17892024-11-27T18:34:44.683ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
17902024-11-27T18:34:44.683ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 0 version = 2
17912024-11-27T18:34:44.683ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17922024-11-27T18:34:44.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17932024-11-27T18:34:44.685ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17942024-11-27T18:34:44.688ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
17952024-11-27T18:34:44.688ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17962024-11-27T18:34:44.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17972024-11-27T18:34:44.692ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17982024-11-27T18:34:44.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17992024-11-27T18:34:44.693ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18002024-11-27T18:34:44.695ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
18012024-11-27T18:34:44.695ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18022024-11-27T18:34:44.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18032024-11-27T18:34:44.695ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
18042024-11-27T18:34:44.695ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
18052024-11-27T18:34:44.695ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18062024-11-27T18:34:44.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18072024-11-27T18:34:44.697ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18082024-11-27T18:34:44.700ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
18092024-11-27T18:34:44.700ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18102024-11-27T18:34:44.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18112024-11-27T18:34:44.703ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (initial) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-27T18:34:28.564237Z, time_modified: 2024-11-27T18:34:28.564237Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(1)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(1)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:77
18122024-11-27T18:34:44.703ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 67.494461ms iteration = 2 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]}},"default_endpoint":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
18132024-11-27T18:34:44.712ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 1 version = 2
18142024-11-27T18:34:44.712ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
18152024-11-27T18:34:44.712ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_external dns_group = external file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 2
18162024-11-27T18:34:44.712ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 76.735437ms iteration = 2 status = {"generation":2}
18172024-11-27T18:34:44.712ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 3 reason = Dependency
18182024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = / versions = all
18192024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /access versions = all
18202024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /assets/{path} versions = all
18212024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/auth versions = all
18222024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/confirm versions = all
18232024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /device/success versions = all
18242024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/token versions = all
18252024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /device/verify versions = all
18262024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/probes versions = all
18272024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /experimental/v1/probes versions = all
18282024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /experimental/v1/probes/{probe} versions = all
18292024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/probes/{probe} versions = all
18302024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /images versions = all
18312024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login versions = all
18322024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/local versions = all
18332024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
18342024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
18352024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
18362024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /lookup/{path} versions = all
18372024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /projects/{path} versions = all
18382024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /projects-new versions = all
18392024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /settings/{path} versions = all
18402024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /system/{path} versions = all
18412024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /utilization versions = all
18422024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/certificates versions = all
18432024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/certificates versions = all
18442024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/certificates/{certificate} versions = all
18452024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/certificates/{certificate} versions = all
18462024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks versions = all
18472024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks versions = all
18482024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/disks/{disk} versions = all
18492024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks/{disk} versions = all
18502024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write versions = all
18512024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
18522024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
18532024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/finalize versions = all
18542024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
18552024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/floating-ips versions = all
18562024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips versions = all
18572024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
18582024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/floating-ips/{floating_ip} versions = all
18592024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
18602024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
18612024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
18622024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/groups versions = all
18632024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/groups/{group_id} versions = all
18642024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/images versions = all
18652024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images versions = all
18662024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/images/{image} versions = all
18672024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/images/{image} versions = all
18682024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images/{image}/demote versions = all
18692024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images/{image}/promote versions = all
18702024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances versions = all
18712024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances versions = all
18722024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/instances/{instance} versions = all
18732024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance} versions = all
18742024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/instances/{instance} versions = all
18752024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/disks versions = all
18762024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/disks/attach versions = all
18772024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/disks/detach versions = all
18782024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/external-ips versions = all
18792024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
18802024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
18812024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/reboot versions = all
18822024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/serial-console versions = all
18832024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
18842024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
18852024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/start versions = all
18862024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/stop versions = all
18872024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateway-ip-addresses versions = all
18882024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateway-ip-addresses versions = all
18892024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
18902024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateway-ip-pools versions = all
18912024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateway-ip-pools versions = all
18922024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
18932024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateways versions = all
18942024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateways versions = all
18952024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
18962024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateways/{gateway} versions = all
18972024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ip-pools versions = all
18982024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ip-pools/{pool} versions = all
18992024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/login/{silo_name}/local versions = all
19002024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/logout versions = all
19012024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me versions = all
19022024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/groups versions = all
19032024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/ssh-keys versions = all
19042024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/me/ssh-keys versions = all
19052024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
19062024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
19072024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/metrics/{metric_name} versions = all
19082024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/network-interfaces versions = all
19092024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/network-interfaces versions = all
19102024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/network-interfaces/{interface} versions = all
19112024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/network-interfaces/{interface} versions = all
19122024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/network-interfaces/{interface} versions = all
19132024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ping versions = all
19142024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/policy versions = all
19152024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/policy versions = all
19162024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects versions = all
19172024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/projects versions = all
19182024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/projects/{project} versions = all
19192024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects/{project} versions = all
19202024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/projects/{project} versions = all
19212024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects/{project}/policy versions = all
19222024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/projects/{project}/policy versions = all
19232024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/snapshots versions = all
19242024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/snapshots versions = all
19252024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/snapshots/{snapshot} versions = all
19262024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/snapshots/{snapshot} versions = all
19272024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/disks versions = all
19282024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
19292024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/racks versions = all
19302024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
19312024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds versions = all
19322024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/sleds versions = all
19332024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
19342024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
19352024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
19362024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
19372024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
19382024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port versions = all
19392024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
19402024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
19412024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
19422024-11-27T18:34:44.718ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switches versions = all
19432024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
19442024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/identity-providers versions = all
19452024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/local/users versions = all
19462024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
19472024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
19482024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/saml versions = all
19492024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
19502024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools versions = all
19512024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools versions = all
19522024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
19532024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool} versions = all
19542024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/ip-pools/{pool} versions = all
19552024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
19562024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
19572024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
19582024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
19592024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
19602024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
19612024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
19622024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
19632024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools-service versions = all
19642024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools-service/ranges versions = all
19652024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
19662024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
19672024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/metrics/{metric_name} versions = all
19682024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/address-lot versions = all
19692024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/address-lot versions = all
19702024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
19712024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
19722024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/allow-list versions = all
19732024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/networking/allow-list versions = all
19742024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bfd-disable versions = all
19752024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bfd-enable versions = all
19762024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bfd-status versions = all
19772024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/bgp versions = all
19782024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp versions = all
19792024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bgp versions = all
19802024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-announce-set versions = all
19812024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
19822024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
19832024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
19842024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-exported versions = all
19852024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-message-history versions = all
19862024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
19872024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-status versions = all
19882024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/loopback-address versions = all
19892024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/loopback-address versions = all
19902024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
19912024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
19922024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/switch-port-settings versions = all
19932024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/switch-port-settings versions = all
19942024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
19952024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/policy versions = all
19962024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/policy versions = all
19972024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/roles versions = all
19982024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/roles/{role_name} versions = all
19992024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silo-quotas versions = all
20002024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos versions = all
20012024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/silos versions = all
20022024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/silos/{silo} versions = all
20032024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo} versions = all
20042024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
20052024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/policy versions = all
20062024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/silos/{silo}/policy versions = all
20072024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/quotas versions = all
20082024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
20092024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/timeseries/query versions = all
20102024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/timeseries/schemas versions = all
20112024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/update/repository versions = all
20122024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/update/repository/{system_version} versions = all
20132024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users versions = all
20142024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users/{user_id} versions = all
20152024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users-builtin versions = all
20162024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users-builtin/{user} versions = all
20172024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/utilization/silos versions = all
20182024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/utilization/silos/{silo} versions = all
20192024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/users versions = all
20202024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/utilization versions = all
20212024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-firewall-rules versions = all
20222024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-firewall-rules versions = all
20232024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-router-routes versions = all
20242024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-router-routes versions = all
20252024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
20262024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-router-routes/{route} versions = all
20272024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-router-routes/{route} versions = all
20282024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-routers versions = all
20292024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-routers versions = all
20302024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-routers/{router} versions = all
20312024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-routers/{router} versions = all
20322024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-routers/{router} versions = all
20332024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets versions = all
20342024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-subnets versions = all
20352024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
20362024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets/{subnet} versions = all
20372024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
20382024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
20392024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpcs versions = all
20402024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpcs versions = all
20412024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpcs/{vpc} versions = all
20422024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpcs/{vpc} versions = all
20432024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpcs/{vpc} versions = all
20442024-11-27T18:34:44.719ZINFOnexus (dropshot_external): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = 172.30.2.7:443
20452024-11-27T18:34:44.719ZDEBGnexus (dropshot_external): successfully registered DTrace USDT probes local_addr = 172.30.2.7:443
20462024-11-27T18:34:44.724ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
20472024-11-27T18:34:44.724ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
20482024-11-27T18:34:44.724ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_internal dns_group = internal file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 1
20492024-11-27T18:34:44.724ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 88.716345ms iteration = 2 status = {"generation":1}
20502024-11-27T18:34:44.724ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 3 reason = Dependency
20512024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = / versions = all
20522024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /access versions = all
20532024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /assets/{path} versions = all
20542024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/auth versions = all
20552024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/confirm versions = all
20562024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /device/success versions = all
20572024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/token versions = all
20582024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /device/verify versions = all
20592024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/probes versions = all
20602024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /experimental/v1/probes versions = all
20612024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /experimental/v1/probes/{probe} versions = all
20622024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/probes/{probe} versions = all
20632024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /images versions = all
20642024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login versions = all
20652024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/local versions = all
20662024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
20672024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
20682024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
20692024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /lookup/{path} versions = all
20702024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /projects/{path} versions = all
20712024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /projects-new versions = all
20722024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /settings/{path} versions = all
20732024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /system/{path} versions = all
20742024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /utilization versions = all
20752024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/certificates versions = all
20762024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/certificates versions = all
20772024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/certificates/{certificate} versions = all
20782024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/certificates/{certificate} versions = all
20792024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks versions = all
20802024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks versions = all
20812024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/disks/{disk} versions = all
20822024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks/{disk} versions = all
20832024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write versions = all
20842024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
20852024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
20862024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/finalize versions = all
20872024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
20882024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/floating-ips versions = all
20892024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips versions = all
20902024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
20912024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/floating-ips/{floating_ip} versions = all
20922024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
20932024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
20942024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
20952024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/groups versions = all
20962024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/groups/{group_id} versions = all
20972024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/images versions = all
20982024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images versions = all
20992024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/images/{image} versions = all
21002024-11-27T18:34:44.725ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/images/{image} versions = all
21012024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images/{image}/demote versions = all
21022024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images/{image}/promote versions = all
21032024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances versions = all
21042024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances versions = all
21052024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/instances/{instance} versions = all
21062024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance} versions = all
21072024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/instances/{instance} versions = all
21082024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/disks versions = all
21092024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/disks/attach versions = all
21102024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/disks/detach versions = all
21112024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/external-ips versions = all
21122024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
21132024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
21142024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/reboot versions = all
21152024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/serial-console versions = all
21162024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
21172024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
21182024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/start versions = all
21192024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/stop versions = all
21202024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateway-ip-addresses versions = all
21212024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateway-ip-addresses versions = all
21222024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
21232024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateway-ip-pools versions = all
21242024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateway-ip-pools versions = all
21252024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
21262024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateways versions = all
21272024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateways versions = all
21282024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
21292024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateways/{gateway} versions = all
21302024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ip-pools versions = all
21312024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ip-pools/{pool} versions = all
21322024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/login/{silo_name}/local versions = all
21332024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/logout versions = all
21342024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me versions = all
21352024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/groups versions = all
21362024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/ssh-keys versions = all
21372024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/me/ssh-keys versions = all
21382024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
21392024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
21402024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/metrics/{metric_name} versions = all
21412024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/network-interfaces versions = all
21422024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/network-interfaces versions = all
21432024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/network-interfaces/{interface} versions = all
21442024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/network-interfaces/{interface} versions = all
21452024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/network-interfaces/{interface} versions = all
21462024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ping versions = all
21472024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/policy versions = all
21482024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/policy versions = all
21492024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects versions = all
21502024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/projects versions = all
21512024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/projects/{project} versions = all
21522024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects/{project} versions = all
21532024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/projects/{project} versions = all
21542024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects/{project}/policy versions = all
21552024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/projects/{project}/policy versions = all
21562024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/snapshots versions = all
21572024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/snapshots versions = all
21582024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/snapshots/{snapshot} versions = all
21592024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/snapshots/{snapshot} versions = all
21602024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/disks versions = all
21612024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
21622024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/racks versions = all
21632024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
21642024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds versions = all
21652024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/sleds versions = all
21662024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
21672024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
21682024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
21692024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
21702024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
21712024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port versions = all
21722024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
21732024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
21742024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
21752024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switches versions = all
21762024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
21772024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/identity-providers versions = all
21782024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/local/users versions = all
21792024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
21802024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
21812024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/saml versions = all
21822024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
21832024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools versions = all
21842024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools versions = all
21852024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
21862024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool} versions = all
21872024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/ip-pools/{pool} versions = all
21882024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
21892024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
21902024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
21912024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
21922024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
21932024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
21942024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
21952024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
21962024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools-service versions = all
21972024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools-service/ranges versions = all
21982024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
21992024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
22002024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/metrics/{metric_name} versions = all
22012024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/address-lot versions = all
22022024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/address-lot versions = all
22032024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
22042024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
22052024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/allow-list versions = all
22062024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/networking/allow-list versions = all
22072024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bfd-disable versions = all
22082024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bfd-enable versions = all
22092024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bfd-status versions = all
22102024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/bgp versions = all
22112024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp versions = all
22122024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bgp versions = all
22132024-11-27T18:34:44.726ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-announce-set versions = all
22142024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
22152024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
22162024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
22172024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-exported versions = all
22182024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-message-history versions = all
22192024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
22202024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-status versions = all
22212024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/loopback-address versions = all
22222024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/loopback-address versions = all
22232024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
22242024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
22252024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/switch-port-settings versions = all
22262024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/switch-port-settings versions = all
22272024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
22282024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/policy versions = all
22292024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/policy versions = all
22302024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/roles versions = all
22312024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/roles/{role_name} versions = all
22322024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silo-quotas versions = all
22332024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos versions = all
22342024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/silos versions = all
22352024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/silos/{silo} versions = all
22362024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo} versions = all
22372024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
22382024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/policy versions = all
22392024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/silos/{silo}/policy versions = all
22402024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/quotas versions = all
22412024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
22422024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/timeseries/query versions = all
22432024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/timeseries/schemas versions = all
22442024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/update/repository versions = all
22452024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/update/repository/{system_version} versions = all
22462024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users versions = all
22472024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users/{user_id} versions = all
22482024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users-builtin versions = all
22492024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users-builtin/{user} versions = all
22502024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/utilization/silos versions = all
22512024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/utilization/silos/{silo} versions = all
22522024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/users versions = all
22532024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/utilization versions = all
22542024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-firewall-rules versions = all
22552024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-firewall-rules versions = all
22562024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-router-routes versions = all
22572024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-router-routes versions = all
22582024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
22592024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-router-routes/{route} versions = all
22602024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-router-routes/{route} versions = all
22612024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-routers versions = all
22622024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-routers versions = all
22632024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-routers/{router} versions = all
22642024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-routers/{router} versions = all
22652024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-routers/{router} versions = all
22662024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets versions = all
22672024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-subnets versions = all
22682024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
22692024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets/{subnet} versions = all
22702024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
22712024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
22722024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpcs versions = all
22732024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpcs versions = all
22742024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpcs/{vpc} versions = all
22752024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpcs/{vpc} versions = all
22762024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpcs/{vpc} versions = all
22772024-11-27T18:34:44.727ZINFOnexus (dropshot_external_techport): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::c]:12228
22782024-11-27T18:34:44.727ZDEBGnexus (dropshot_external_techport): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:12228
22792024-11-27T18:34:44.729ZDEBGnexus (nexus-producer-server): registered DTrace probes
22802024-11-27T18:34:44.731ZDEBGnexus (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::c]:33512 method = GET path = /{producer_id} versions = all
22812024-11-27T18:34:44.732ZINFOnexus (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::c]:33512
22822024-11-27T18:34:44.732ZDEBGnexus (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:33512
22832024-11-27T18:34:44.732ZDEBGnexus (nexus-producer-server): Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::c]:33512
22842024-11-27T18:34:44.732ZDEBGnexus (nexus-producer-server): Nexus IP provided explicitly, will use it addr = [fd00:1122:3344:101::c]:12221
22852024-11-27T18:34:44.732ZDEBGnexus (nexus-producer-server): starting producer registration task
22862024-11-27T18:34:44.733ZINFOnexus (nexus-producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::c]:33512 file = oximeter/producer/src/lib.rs:279 interval = 10s producer_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
22872024-11-27T18:34:44.733ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
22882024-11-27T18:34:44.733ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
22892024-11-27T18:34:44.835ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 75312a92-5758-4131-946f-9c163d729fb7 file = nexus/db-queries/src/db/datastore/inventory.rs:1452 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 0 nerrors = 0 nnics = 0 nnvme_disk_firmware = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
22902024-11-27T18:34:44.835ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
22912024-11-27T18:34:44.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
22922024-11-27T18:34:44.841ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
22932024-11-27T18:34:44.841ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:50012
22942024-11-27T18:34:44.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:50012 req_id = 26123cba-a12e-467b-9905-23963937d064 roles = RoleSet { roles: {} } uri = /metrics/producers
22952024-11-27T18:34:44.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:50012 req_id = 26123cba-a12e-467b-9905-23963937d064 resource = Database result = Ok(()) uri = /metrics/producers
22962024-11-27T18:34:44.843ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(b845cb2a-c1b0-4e85-86db-5319430db8f0, 0), (13f59999-9c86-4dfc-a124-b6c19f1b3024, 0), (64504a1c-7931-4bfd-b548-bce7e883eb71, 0)]
22972024-11-27T18:34:44.844ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2118, tv_nsec: 842762336 } })
22982024-11-27T18:34:44.845ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
22992024-11-27T18:34:44.917ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
23002024-11-27T18:34:44.930ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
23012024-11-27T18:34:44.930ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
23022024-11-27T18:34:44.930ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
23032024-11-27T18:34:44.931ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2ab3cb2-fe60-40db-824d-30f984e82ca6", "content-length": "476", "date": "Wed, 27 Nov 2024 18:34:44 GMT"} })
23042024-11-27T18:34:44.931ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
23052024-11-27T18:34:44.931ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3168710b-37ec-4f53-a710-3af25491d30f", "content-length": "734", "date": "Wed, 27 Nov 2024 18:34:44 GMT"} })
23062024-11-27T18:34:44.931ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
23072024-11-27T18:34:44.932ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff5f1d77-c00e-4242-a994-c2722ff05d66", "content-length": "111", "date": "Wed, 27 Nov 2024 18:34:44 GMT"} })
23082024-11-27T18:34:44.932ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
23092024-11-27T18:34:44.932ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "dea6150f-1dc5-4ef6-b837-d0ac46201951", "content-length": "111", "date": "Wed, 27 Nov 2024 18:34:44 GMT"} })
23102024-11-27T18:34:44.932ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
23112024-11-27T18:34:44.932ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1dcecb1c-faa6-4a6b-af71-2234d3d7f82f", "content-length": "167", "date": "Wed, 27 Nov 2024 18:34:44 GMT"} })
23122024-11-27T18:34:44.932ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
23132024-11-27T18:34:44.933ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a0ed234-9181-4f97-bf12-cf2671724e3f", "content-length": "167", "date": "Wed, 27 Nov 2024 18:34:44 GMT"} })
23142024-11-27T18:34:44.933ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
23152024-11-27T18:34:44.933ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2ee43d6-641e-411c-9b50-f432cc4bcbe6", "content-length": "175", "date": "Wed, 27 Nov 2024 18:34:44 GMT"} })
23162024-11-27T18:34:44.933ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
23172024-11-27T18:34:44.933ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e9548a1-d16d-4377-b7c5-ac09d4015337", "content-length": "175", "date": "Wed, 27 Nov 2024 18:34:44 GMT"} })
23182024-11-27T18:34:44.933ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
23192024-11-27T18:34:44.933ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a23f2058-2411-4ad7-abbd-feec03488854", "content-length": "702", "date": "Wed, 27 Nov 2024 18:34:44 GMT"} })
23202024-11-27T18:34:44.933ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
23212024-11-27T18:34:44.933ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f038579-7f57-485d-b8af-aee24b8b6b19", "content-length": "727", "date": "Wed, 27 Nov 2024 18:34:44 GMT"} })
23222024-11-27T18:34:44.933ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
23232024-11-27T18:34:44.934ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "84584117-e5b4-457b-b572-00681abc0d2c", "content-length": "729", "date": "Wed, 27 Nov 2024 18:34:44 GMT"} })
23242024-11-27T18:34:44.934ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
23252024-11-27T18:34:44.934ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3346d8b7-fb4a-441f-82f8-cbec127d646d", "content-length": "728", "date": "Wed, 27 Nov 2024 18:34:44 GMT"} })
23262024-11-27T18:34:44.934ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
23272024-11-27T18:34:44.934ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "20d0ca67-93a0-4e90-91f7-f687c1ed8d53", "content-length": "722", "date": "Wed, 27 Nov 2024 18:34:44 GMT"} })
23282024-11-27T18:34:44.934ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
23292024-11-27T18:34:44.934ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "21dfea96-4130-49dc-9bcb-752f97580e9f", "content-length": "109", "date": "Wed, 27 Nov 2024 18:34:44 GMT"} })
23302024-11-27T18:34:44.934ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
23312024-11-27T18:34:44.935ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "21ca5788-1734-4254-a9b7-44803b3a70d5", "content-length": "109", "date": "Wed, 27 Nov 2024 18:34:44 GMT"} })
23322024-11-27T18:34:44.935ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
23332024-11-27T18:34:44.935ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "97195677-feb4-4c54-8aa6-5fe99976a623", "content-length": "169", "date": "Wed, 27 Nov 2024 18:34:44 GMT"} })
23342024-11-27T18:34:44.935ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
23352024-11-27T18:34:44.935ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0b15249-d35b-4ba0-8da9-19100868e1e1", "content-length": "169", "date": "Wed, 27 Nov 2024 18:34:44 GMT"} })
23362024-11-27T18:34:44.935ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
23372024-11-27T18:34:44.936ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "14a4dc39-a7c3-42ed-a547-371afd0bdb42", "content-length": "178", "date": "Wed, 27 Nov 2024 18:34:44 GMT"} })
23382024-11-27T18:34:44.936ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
23392024-11-27T18:34:44.936ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e9a8165-754c-4122-bbc9-ac15a8e9e83a", "content-length": "178", "date": "Wed, 27 Nov 2024 18:34:44 GMT"} })
23402024-11-27T18:34:44.936ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
23412024-11-27T18:34:44.936ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "794e7994-6320-4f9d-92c4-4b1cc88d2c3c", "content-length": "702", "date": "Wed, 27 Nov 2024 18:34:44 GMT"} })
23422024-11-27T18:34:44.936ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
23432024-11-27T18:34:44.936ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9b3ea6e-d82a-474c-b5e8-ff4e50836902", "content-length": "727", "date": "Wed, 27 Nov 2024 18:34:44 GMT"} })
23442024-11-27T18:34:44.936ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
23452024-11-27T18:34:44.936ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "18559cbf-1525-4805-be83-94216893b03a", "content-length": "729", "date": "Wed, 27 Nov 2024 18:34:44 GMT"} })
23462024-11-27T18:34:44.936ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
23472024-11-27T18:34:44.937ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f060e583-ed9d-44c8-a8d4-c0ad8ef6675a", "content-length": "728", "date": "Wed, 27 Nov 2024 18:34:44 GMT"} })
23482024-11-27T18:34:44.937ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
23492024-11-27T18:34:44.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
23502024-11-27T18:34:44.939ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23512024-11-27T18:34:44.940ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
23522024-11-27T18:34:44.940ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
23532024-11-27T18:34:44.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
23542024-11-27T18:34:44.942ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23552024-11-27T18:34:44.944ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
23562024-11-27T18:34:44.944ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
23572024-11-27T18:34:44.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
23582024-11-27T18:34:44.954ZINFOnexus: assigned collector to new producer collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:76 producer_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
23592024-11-27T18:34:44.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112601 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:50012 req_id = 26123cba-a12e-467b-9905-23963937d064 response_code = 201 uri = /metrics/producers
23602024-11-27T18:34:44.954ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "26123cba-a12e-467b-9905-23963937d064", "content-length": "41", "date": "Wed, 27 Nov 2024 18:34:44 GMT"} })
23612024-11-27T18:34:44.956ZDEBGnexus (producer-registration-task): registered with nexus successfully
23622024-11-27T18:34:44.956ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
23632024-11-27T18:34:45.043ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
23642024-11-27T18:34:45.073ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "298109ca-21cb-4010-be9c-cfea351d6411", "date": "Wed, 27 Nov 2024 18:34:45 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
23652024-11-27T18:34:45.073ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
23662024-11-27T18:34:45.074ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "e523750c-2bc9-4d1d-bd70-0fa174b212a5", "date": "Wed, 27 Nov 2024 18:34:45 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
23672024-11-27T18:34:45.074ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
23682024-11-27T18:34:45.076ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
23692024-11-27T18:34:45.076ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 363.309635ms iteration = 3 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
23702024-11-27T18:34:45.111ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
23712024-11-27T18:34:45.122ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
23722024-11-27T18:34:45.122ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
23732024-11-27T18:34:45.152ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
23742024-11-27T18:34:45.180ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "b76ffe94-7681-444c-87a5-2eedf66097ea", "date": "Wed, 27 Nov 2024 18:34:45 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
23752024-11-27T18:34:45.180ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
23762024-11-27T18:34:45.182ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "9c346f3c-449c-40ba-9144-379e5cedd1fd", "date": "Wed, 27 Nov 2024 18:34:45 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
23772024-11-27T18:34:45.182ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
23782024-11-27T18:34:45.184ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "30e3ec43-fa7d-410c-a464-3d30a5cde125", "date": "Wed, 27 Nov 2024 18:34:45 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
23792024-11-27T18:34:45.184ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
23802024-11-27T18:34:45.186ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
23812024-11-27T18:34:45.186ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 461.527421ms iteration = 3 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
23822024-11-27T18:34:45.373ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "a14411e4-3d5d-46f4-8f36-4ce33186897f", "content-length": "30783", "date": "Wed, 27 Nov 2024 18:34:44 GMT"} })
23832024-11-27T18:34:45.375ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
23842024-11-27T18:34:45.375ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
23852024-11-27T18:34:45.375ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
23862024-11-27T18:34:45.376ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
23872024-11-27T18:34:45.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
23882024-11-27T18:34:45.378ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23892024-11-27T18:34:45.380ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
23902024-11-27T18:34:45.380ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
23912024-11-27T18:34:45.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
23922024-11-27T18:34:45.557ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 2be03475-eba6-49d5-8d88-f99c929a0c6f file = nexus/db-queries/src/db/datastore/inventory.rs:1006
23932024-11-27T18:34:45.557ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 2be03475-eba6-49d5-8d88-f99c929a0c6f time_started = 2024-11-27 18:34:44.930854 UTC
23942024-11-27T18:34:45.557ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 921.768722ms iteration = 2 status = {"collection_id":"2be03475-eba6-49d5-8d88-f99c929a0c6f","time_done":"2024-11-27 18:34:45.375347 UTC","time_started":"2024-11-27 18:34:44.930854 UTC"}
23952024-11-27T18:34:45.557ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 3 reason = Dependency
23962024-11-27T18:34:45.557ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23972024-11-27T18:34:45.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23982024-11-27T18:34:45.559ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23992024-11-27T18:34:45.561ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24002024-11-27T18:34:45.561ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24012024-11-27T18:34:45.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24022024-11-27T18:34:45.562ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24032024-11-27T18:34:45.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24042024-11-27T18:34:45.564ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24052024-11-27T18:34:45.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24062024-11-27T18:34:45.566ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24072024-11-27T18:34:45.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24082024-11-27T18:34:45.587ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 29.919923ms iteration = 3 status = {"physical_disks_added":0}
24092024-11-27T18:34:47.635ZDEBGnexus (NexusCertResolver): resolved TLS certificate certificate = TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" } server_name = recovery.sys.oxide.test silo_id = 40016410-ac98-42a3-b0ca-e7ce46b4e8ba
24102024-11-27T18:34:47.641ZINFOnexus (dropshot_external): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = 172.30.2.7:443 remote_addr = 10.151.2.100:50748
24112024-11-27T18:34:47.658ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24122024-11-27T18:34:47.660ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24132024-11-27T18:34:47.669ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24142024-11-27T18:34:47.669ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24152024-11-27T18:34:47.671ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24162024-11-27T18:34:47.672ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24172024-11-27T18:34:47.673ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24182024-11-27T18:34:47.674ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ByName("recovery") } result = Ok(())
24192024-11-27T18:34:47.674ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24202024-11-27T18:34:47.674ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24212024-11-27T18:34:47.676ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24222024-11-27T18:34:47.676ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24232024-11-27T18:34:47.678ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24242024-11-27T18:34:47.681ZDEBGnexus (ExternalAuthn): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ByName("recovery") } result = Ok(())
24252024-11-27T18:34:47.681ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24262024-11-27T18:34:47.681ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24272024-11-27T18:34:47.683ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24282024-11-27T18:34:47.683ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24292024-11-27T18:34:47.685ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24302024-11-27T18:34:47.685ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24312024-11-27T18:34:47.686ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24322024-11-27T18:34:47.687ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ByName("recovery") }, key: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, lookup_type: ByName("recovery") } result = Ok(())
24332024-11-27T18:34:47.687ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24342024-11-27T18:34:47.687ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24352024-11-27T18:34:48.389ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24362024-11-27T18:34:48.389ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24372024-11-27T18:34:48.392ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24382024-11-27T18:34:48.392ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24392024-11-27T18:34:48.394ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24402024-11-27T18:34:48.394ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24412024-11-27T18:34:48.396ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24422024-11-27T18:34:48.396ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24432024-11-27T18:34:48.397ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24442024-11-27T18:34:48.399ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, lookup_type: ById(0b2a0ba2-c679-4886-a1b8-ae9858bb938c) } result = Ok(())
24452024-11-27T18:34:48.399ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24462024-11-27T18:34:48.399ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24472024-11-27T18:34:48.400ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24482024-11-27T18:34:48.402ZDEBGnexus (ExternalAuthn): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSessionList result = Ok(())
24492024-11-27T18:34:48.402ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24502024-11-27T18:34:48.402ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24512024-11-27T18:34:48.405ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 760057 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:50748 req_id = 5383e7af-3057-402d-94c9-2a18162a5345 response_code = 204 uri = /v1/login/recovery/local
24522024-11-27T18:34:48.446ZDEBGnexus (NexusCertResolver): resolved TLS certificate certificate = TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" } server_name = recovery.sys.oxide.test silo_id = 40016410-ac98-42a3-b0ca-e7ce46b4e8ba
24532024-11-27T18:34:48.451ZINFOnexus (dropshot_external): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = 172.30.2.7:443 remote_addr = 10.151.2.100:40247
24542024-11-27T18:34:48.456ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24552024-11-27T18:34:48.456ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24562024-11-27T18:34:48.469ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24572024-11-27T18:34:48.469ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24582024-11-27T18:34:48.471ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24592024-11-27T18:34:48.472ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "e736b427937bfa233f37989e8bdecb952a09e936", lookup_type: ByCompositeId("token = \\"e736b427937bfa233f37989e8bdecb952a09e936\\"") } result = Ok(())
24602024-11-27T18:34:48.472ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24612024-11-27T18:34:48.472ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24622024-11-27T18:34:48.473ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24632024-11-27T18:34:48.474ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24642024-11-27T18:34:48.476ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24652024-11-27T18:34:48.476ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24662024-11-27T18:34:48.477ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24672024-11-27T18:34:48.477ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24682024-11-27T18:34:48.479ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24692024-11-27T18:34:48.480ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, lookup_type: ById(0b2a0ba2-c679-4886-a1b8-ae9858bb938c) } result = Ok(())
24702024-11-27T18:34:48.480ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24712024-11-27T18:34:48.480ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24722024-11-27T18:34:48.481ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24732024-11-27T18:34:48.483ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "e736b427937bfa233f37989e8bdecb952a09e936", lookup_type: ByCompositeId("e736b427937bfa233f37989e8bdecb952a09e936") } result = Ok(())
24742024-11-27T18:34:48.483ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24752024-11-27T18:34:48.483ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24762024-11-27T18:34:48.485ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24772024-11-27T18:34:48.485ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24782024-11-27T18:34:48.487ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24792024-11-27T18:34:48.487ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24802024-11-27T18:34:48.489ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24812024-11-27T18:34:48.489ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24822024-11-27T18:34:48.491ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24832024-11-27T18:34:48.491ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24842024-11-27T18:34:48.492ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24852024-11-27T18:34:48.493ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, lookup_type: ById(0b2a0ba2-c679-4886-a1b8-ae9858bb938c) } result = Ok(())
24862024-11-27T18:34:48.493ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24872024-11-27T18:34:48.493ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24882024-11-27T18:34:48.495ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24892024-11-27T18:34:48.495ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24902024-11-27T18:34:48.496ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24912024-11-27T18:34:48.496ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24922024-11-27T18:34:48.498ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24932024-11-27T18:34:48.499ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) } result = Ok(())
24942024-11-27T18:34:48.499ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.2.100:40247 req_id = 169bf2f5-0a22-4b82-bfb7-9de6149af7cb roles = RoleSet { roles: {} } uri = /v1/projects
24952024-11-27T18:34:48.499ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.2.100:40247 req_id = 169bf2f5-0a22-4b82-bfb7-9de6149af7cb resource = Database result = Ok(()) uri = /v1/projects
24962024-11-27T18:34:48.519ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.2.100:40247 req_id = 169bf2f5-0a22-4b82-bfb7-9de6149af7cb roles = RoleSet { roles: {} } uri = /v1/projects
24972024-11-27T18:34:48.520ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.2.100:40247 req_id = 169bf2f5-0a22-4b82-bfb7-9de6149af7cb resource = Database result = Ok(()) uri = /v1/projects
24982024-11-27T18:34:48.523ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.2.100:40247 req_id = 169bf2f5-0a22-4b82-bfb7-9de6149af7cb roles = RoleSet { roles: {} } uri = /v1/projects
24992024-11-27T18:34:48.524ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.2.100:40247 req_id = 169bf2f5-0a22-4b82-bfb7-9de6149af7cb resource = Database result = Ok(()) uri = /v1/projects
25002024-11-27T18:34:48.526ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.2.100:40247 req_id = 169bf2f5-0a22-4b82-bfb7-9de6149af7cb roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } uri = /v1/projects
25012024-11-27T18:34:48.528ZDEBGnexus (dropshot_external): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.2.100:40247 req_id = 169bf2f5-0a22-4b82-bfb7-9de6149af7cb resource = Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) } result = Ok(()) uri = /v1/projects
25022024-11-27T18:34:48.528ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.2.100:40247 req_id = 169bf2f5-0a22-4b82-bfb7-9de6149af7cb roles = RoleSet { roles: {} } uri = /v1/projects
25032024-11-27T18:34:48.528ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.2.100:40247 req_id = 169bf2f5-0a22-4b82-bfb7-9de6149af7cb resource = Database result = Ok(()) uri = /v1/projects
25042024-11-27T18:34:48.530ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78649 local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.2.100:40247 req_id = 169bf2f5-0a22-4b82-bfb7-9de6149af7cb response_code = 200 uri = /v1/projects
25052024-11-27T18:34:48.535ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25062024-11-27T18:34:48.535ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25072024-11-27T18:34:48.536ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25082024-11-27T18:34:48.536ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25092024-11-27T18:34:48.538ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25102024-11-27T18:34:48.539ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "e736b427937bfa233f37989e8bdecb952a09e936", lookup_type: ByCompositeId("token = \\"e736b427937bfa233f37989e8bdecb952a09e936\\"") } result = Ok(())
25112024-11-27T18:34:48.539ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25122024-11-27T18:34:48.539ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25132024-11-27T18:34:48.541ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25142024-11-27T18:34:48.541ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25152024-11-27T18:34:48.542ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25162024-11-27T18:34:48.542ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25172024-11-27T18:34:48.544ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25182024-11-27T18:34:48.544ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25192024-11-27T18:34:48.545ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25202024-11-27T18:34:48.546ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, lookup_type: ById(0b2a0ba2-c679-4886-a1b8-ae9858bb938c) } result = Ok(())
25212024-11-27T18:34:48.546ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25222024-11-27T18:34:48.546ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25232024-11-27T18:34:48.548ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25242024-11-27T18:34:48.549ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "e736b427937bfa233f37989e8bdecb952a09e936", lookup_type: ByCompositeId("e736b427937bfa233f37989e8bdecb952a09e936") } result = Ok(())
25252024-11-27T18:34:48.549ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25262024-11-27T18:34:48.549ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25272024-11-27T18:34:48.552ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25282024-11-27T18:34:48.552ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25292024-11-27T18:34:48.553ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25302024-11-27T18:34:48.554ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25312024-11-27T18:34:48.555ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25322024-11-27T18:34:48.555ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25332024-11-27T18:34:48.556ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25342024-11-27T18:34:48.557ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25352024-11-27T18:34:48.558ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25362024-11-27T18:34:48.559ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, lookup_type: ById(0b2a0ba2-c679-4886-a1b8-ae9858bb938c) } result = Ok(())
25372024-11-27T18:34:48.559ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25382024-11-27T18:34:48.559ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25392024-11-27T18:34:48.561ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25402024-11-27T18:34:48.561ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25412024-11-27T18:34:48.562ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25422024-11-27T18:34:48.562ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25432024-11-27T18:34:48.564ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25442024-11-27T18:34:48.565ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) } result = Ok(())
25452024-11-27T18:34:48.567ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 8b627434-1dcd-4511-a1c6-b219911855ad roles = RoleSet { roles: {} } uri = /v1/system/ip-pools
25462024-11-27T18:34:48.567ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 8b627434-1dcd-4511-a1c6-b219911855ad resource = Database result = Ok(()) uri = /v1/system/ip-pools
25472024-11-27T18:34:48.571ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 8b627434-1dcd-4511-a1c6-b219911855ad roles = RoleSet { roles: {} } uri = /v1/system/ip-pools
25482024-11-27T18:34:48.571ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 8b627434-1dcd-4511-a1c6-b219911855ad resource = Database result = Ok(()) uri = /v1/system/ip-pools
25492024-11-27T18:34:48.573ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 8b627434-1dcd-4511-a1c6-b219911855ad roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } uri = /v1/system/ip-pools
25502024-11-27T18:34:48.575ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 8b627434-1dcd-4511-a1c6-b219911855ad resource = IpPoolList result = Ok(()) uri = /v1/system/ip-pools
25512024-11-27T18:34:48.575ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 8b627434-1dcd-4511-a1c6-b219911855ad roles = RoleSet { roles: {} } uri = /v1/system/ip-pools
25522024-11-27T18:34:48.575ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 8b627434-1dcd-4511-a1c6-b219911855ad resource = Database result = Ok(()) uri = /v1/system/ip-pools
25532024-11-27T18:34:48.579ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44478 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 8b627434-1dcd-4511-a1c6-b219911855ad response_code = 201 uri = /v1/system/ip-pools
25542024-11-27T18:34:48.583ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25552024-11-27T18:34:48.583ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25562024-11-27T18:34:48.585ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25572024-11-27T18:34:48.585ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25582024-11-27T18:34:48.586ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25592024-11-27T18:34:48.587ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "e736b427937bfa233f37989e8bdecb952a09e936", lookup_type: ByCompositeId("token = \\"e736b427937bfa233f37989e8bdecb952a09e936\\"") } result = Ok(())
25602024-11-27T18:34:48.587ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25612024-11-27T18:34:48.587ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25622024-11-27T18:34:48.589ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25632024-11-27T18:34:48.589ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25642024-11-27T18:34:48.590ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25652024-11-27T18:34:48.591ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25662024-11-27T18:34:48.592ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25672024-11-27T18:34:48.592ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25682024-11-27T18:34:48.593ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25692024-11-27T18:34:48.594ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, lookup_type: ById(0b2a0ba2-c679-4886-a1b8-ae9858bb938c) } result = Ok(())
25702024-11-27T18:34:48.594ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25712024-11-27T18:34:48.594ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25722024-11-27T18:34:48.595ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25732024-11-27T18:34:48.597ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "e736b427937bfa233f37989e8bdecb952a09e936", lookup_type: ByCompositeId("e736b427937bfa233f37989e8bdecb952a09e936") } result = Ok(())
25742024-11-27T18:34:48.597ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25752024-11-27T18:34:48.597ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25762024-11-27T18:34:48.600ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25772024-11-27T18:34:48.601ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25782024-11-27T18:34:48.602ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25792024-11-27T18:34:48.602ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25802024-11-27T18:34:48.604ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25812024-11-27T18:34:48.604ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25822024-11-27T18:34:48.605ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25832024-11-27T18:34:48.605ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25842024-11-27T18:34:48.606ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25852024-11-27T18:34:48.608ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, lookup_type: ById(0b2a0ba2-c679-4886-a1b8-ae9858bb938c) } result = Ok(())
25862024-11-27T18:34:48.608ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25872024-11-27T18:34:48.608ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25882024-11-27T18:34:48.609ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25892024-11-27T18:34:48.609ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25902024-11-27T18:34:48.610ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25912024-11-27T18:34:48.611ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25922024-11-27T18:34:48.612ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25932024-11-27T18:34:48.613ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) } result = Ok(())
25942024-11-27T18:34:48.613ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 15940f18-ef31-4df5-b12f-b35e94f47a97 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
25952024-11-27T18:34:48.613ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 15940f18-ef31-4df5-b12f-b35e94f47a97 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
25962024-11-27T18:34:48.615ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 15940f18-ef31-4df5-b12f-b35e94f47a97 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
25972024-11-27T18:34:48.615ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 15940f18-ef31-4df5-b12f-b35e94f47a97 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
25982024-11-27T18:34:48.618ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 15940f18-ef31-4df5-b12f-b35e94f47a97 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
25992024-11-27T18:34:48.618ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 15940f18-ef31-4df5-b12f-b35e94f47a97 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
26002024-11-27T18:34:48.621ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 15940f18-ef31-4df5-b12f-b35e94f47a97 roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } uri = /v1/system/ip-pools/default/silos
26012024-11-27T18:34:48.623ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 15940f18-ef31-4df5-b12f-b35e94f47a97 resource = IpPool { parent: Fleet, key: efd048d3-78e2-4e26-8946-f46726ee021d, lookup_type: ByName("default") } result = Ok(()) uri = /v1/system/ip-pools/default/silos
26022024-11-27T18:34:48.623ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 15940f18-ef31-4df5-b12f-b35e94f47a97 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
26032024-11-27T18:34:48.623ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 15940f18-ef31-4df5-b12f-b35e94f47a97 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
26042024-11-27T18:34:48.625ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 15940f18-ef31-4df5-b12f-b35e94f47a97 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
26052024-11-27T18:34:48.625ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 15940f18-ef31-4df5-b12f-b35e94f47a97 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
26062024-11-27T18:34:48.628ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 15940f18-ef31-4df5-b12f-b35e94f47a97 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
26072024-11-27T18:34:48.628ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 15940f18-ef31-4df5-b12f-b35e94f47a97 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
26082024-11-27T18:34:48.630ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 15940f18-ef31-4df5-b12f-b35e94f47a97 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
26092024-11-27T18:34:48.630ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 15940f18-ef31-4df5-b12f-b35e94f47a97 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
26102024-11-27T18:34:48.632ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 15940f18-ef31-4df5-b12f-b35e94f47a97 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
26112024-11-27T18:34:48.632ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 15940f18-ef31-4df5-b12f-b35e94f47a97 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
26122024-11-27T18:34:48.635ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 15940f18-ef31-4df5-b12f-b35e94f47a97 roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } uri = /v1/system/ip-pools/default/silos
26132024-11-27T18:34:48.636ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 15940f18-ef31-4df5-b12f-b35e94f47a97 resource = Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ByName("recovery") } result = Ok(()) uri = /v1/system/ip-pools/default/silos
26142024-11-27T18:34:48.636ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 15940f18-ef31-4df5-b12f-b35e94f47a97 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
26152024-11-27T18:34:48.636ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 15940f18-ef31-4df5-b12f-b35e94f47a97 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
26162024-11-27T18:34:48.639ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 15940f18-ef31-4df5-b12f-b35e94f47a97 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
26172024-11-27T18:34:48.639ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 15940f18-ef31-4df5-b12f-b35e94f47a97 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
26182024-11-27T18:34:48.641ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 15940f18-ef31-4df5-b12f-b35e94f47a97 roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } uri = /v1/system/ip-pools/default/silos
26192024-11-27T18:34:48.643ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 15940f18-ef31-4df5-b12f-b35e94f47a97 resource = IpPoolList result = Ok(()) uri = /v1/system/ip-pools/default/silos
26202024-11-27T18:34:48.643ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 15940f18-ef31-4df5-b12f-b35e94f47a97 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
26212024-11-27T18:34:48.643ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 15940f18-ef31-4df5-b12f-b35e94f47a97 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
26222024-11-27T18:34:48.685ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104368 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 15940f18-ef31-4df5-b12f-b35e94f47a97 response_code = 201 uri = /v1/system/ip-pools/default/silos
26232024-11-27T18:34:48.687ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26242024-11-27T18:34:48.687ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26252024-11-27T18:34:48.689ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26262024-11-27T18:34:48.689ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26272024-11-27T18:34:48.691ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26282024-11-27T18:34:48.692ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "e736b427937bfa233f37989e8bdecb952a09e936", lookup_type: ByCompositeId("token = \\"e736b427937bfa233f37989e8bdecb952a09e936\\"") } result = Ok(())
26292024-11-27T18:34:48.692ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26302024-11-27T18:34:48.692ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26312024-11-27T18:34:48.694ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26322024-11-27T18:34:48.694ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26332024-11-27T18:34:48.695ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26342024-11-27T18:34:48.696ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26352024-11-27T18:34:48.696ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26362024-11-27T18:34:48.697ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26372024-11-27T18:34:48.698ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26382024-11-27T18:34:48.699ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, lookup_type: ById(0b2a0ba2-c679-4886-a1b8-ae9858bb938c) } result = Ok(())
26392024-11-27T18:34:48.699ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26402024-11-27T18:34:48.699ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26412024-11-27T18:34:48.701ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26422024-11-27T18:34:48.702ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "e736b427937bfa233f37989e8bdecb952a09e936", lookup_type: ByCompositeId("e736b427937bfa233f37989e8bdecb952a09e936") } result = Ok(())
26432024-11-27T18:34:48.702ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26442024-11-27T18:34:48.702ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26452024-11-27T18:34:48.705ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26462024-11-27T18:34:48.706ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26472024-11-27T18:34:48.707ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26482024-11-27T18:34:48.707ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26492024-11-27T18:34:48.708ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26502024-11-27T18:34:48.708ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26512024-11-27T18:34:48.709ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26522024-11-27T18:34:48.710ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26532024-11-27T18:34:48.711ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26542024-11-27T18:34:48.712ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, lookup_type: ById(0b2a0ba2-c679-4886-a1b8-ae9858bb938c) } result = Ok(())
26552024-11-27T18:34:48.712ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26562024-11-27T18:34:48.712ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26572024-11-27T18:34:48.713ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26582024-11-27T18:34:48.714ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26592024-11-27T18:34:48.715ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26602024-11-27T18:34:48.715ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26612024-11-27T18:34:48.716ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26622024-11-27T18:34:48.717ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) } result = Ok(())
26632024-11-27T18:34:48.717ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 129095ff-5851-470e-b77d-f0538c0f9f9f roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
26642024-11-27T18:34:48.717ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 129095ff-5851-470e-b77d-f0538c0f9f9f resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
26652024-11-27T18:34:48.719ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 129095ff-5851-470e-b77d-f0538c0f9f9f roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
26662024-11-27T18:34:48.719ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 129095ff-5851-470e-b77d-f0538c0f9f9f resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
26672024-11-27T18:34:48.722ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 129095ff-5851-470e-b77d-f0538c0f9f9f roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
26682024-11-27T18:34:48.722ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 129095ff-5851-470e-b77d-f0538c0f9f9f resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
26692024-11-27T18:34:48.724ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 129095ff-5851-470e-b77d-f0538c0f9f9f roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } uri = /v1/system/ip-pools/default/ranges/add
26702024-11-27T18:34:48.726ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 129095ff-5851-470e-b77d-f0538c0f9f9f resource = IpPool { parent: Fleet, key: efd048d3-78e2-4e26-8946-f46726ee021d, lookup_type: ByName("default") } result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
26712024-11-27T18:34:48.726ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 129095ff-5851-470e-b77d-f0538c0f9f9f roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
26722024-11-27T18:34:48.726ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 129095ff-5851-470e-b77d-f0538c0f9f9f resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
26732024-11-27T18:34:48.728ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 129095ff-5851-470e-b77d-f0538c0f9f9f roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
26742024-11-27T18:34:48.728ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 129095ff-5851-470e-b77d-f0538c0f9f9f resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
26752024-11-27T18:34:48.729ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 129095ff-5851-470e-b77d-f0538c0f9f9f roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
26762024-11-27T18:34:48.729ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 129095ff-5851-470e-b77d-f0538c0f9f9f resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
26772024-11-27T18:34:48.731ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 129095ff-5851-470e-b77d-f0538c0f9f9f roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
26782024-11-27T18:34:48.731ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 129095ff-5851-470e-b77d-f0538c0f9f9f resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
26792024-11-27T18:34:48.734ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 129095ff-5851-470e-b77d-f0538c0f9f9f roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } uri = /v1/system/ip-pools/default/ranges/add
26802024-11-27T18:34:48.735ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 129095ff-5851-470e-b77d-f0538c0f9f9f resource = IpPool { parent: Fleet, key: efd048d3-78e2-4e26-8946-f46726ee021d, lookup_type: ByName("default") } result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
26812024-11-27T18:34:48.740ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52820 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 129095ff-5851-470e-b77d-f0538c0f9f9f response_code = 201 uri = /v1/system/ip-pools/default/ranges/add
26822024-11-27T18:34:48.742ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26832024-11-27T18:34:48.743ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26842024-11-27T18:34:48.744ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26852024-11-27T18:34:48.744ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26862024-11-27T18:34:48.745ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26872024-11-27T18:34:48.746ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "e736b427937bfa233f37989e8bdecb952a09e936", lookup_type: ByCompositeId("token = \\"e736b427937bfa233f37989e8bdecb952a09e936\\"") } result = Ok(())
26882024-11-27T18:34:48.746ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26892024-11-27T18:34:48.746ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26902024-11-27T18:34:48.747ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26912024-11-27T18:34:48.747ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26922024-11-27T18:34:48.749ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26932024-11-27T18:34:48.749ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26942024-11-27T18:34:48.750ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26952024-11-27T18:34:48.750ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26962024-11-27T18:34:48.752ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26972024-11-27T18:34:48.753ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, lookup_type: ById(0b2a0ba2-c679-4886-a1b8-ae9858bb938c) } result = Ok(())
26982024-11-27T18:34:48.753ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26992024-11-27T18:34:48.753ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27002024-11-27T18:34:48.754ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27012024-11-27T18:34:48.755ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "e736b427937bfa233f37989e8bdecb952a09e936", lookup_type: ByCompositeId("e736b427937bfa233f37989e8bdecb952a09e936") } result = Ok(())
27022024-11-27T18:34:48.755ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27032024-11-27T18:34:48.755ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27042024-11-27T18:34:48.758ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27052024-11-27T18:34:48.758ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27062024-11-27T18:34:48.759ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27072024-11-27T18:34:48.759ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27082024-11-27T18:34:48.760ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27092024-11-27T18:34:48.761ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27102024-11-27T18:34:48.762ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27112024-11-27T18:34:48.762ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27122024-11-27T18:34:48.763ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27132024-11-27T18:34:48.764ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, lookup_type: ById(0b2a0ba2-c679-4886-a1b8-ae9858bb938c) } result = Ok(())
27142024-11-27T18:34:48.764ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27152024-11-27T18:34:48.764ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27162024-11-27T18:34:48.765ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27172024-11-27T18:34:48.765ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27182024-11-27T18:34:48.767ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27192024-11-27T18:34:48.767ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27202024-11-27T18:34:48.768ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27212024-11-27T18:34:48.769ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) } result = Ok(())
27222024-11-27T18:34:48.769ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:40247 req_id = ea7dc275-fd39-4ce1-be1e-bc8fd0a56708 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
27232024-11-27T18:34:48.769ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:40247 req_id = ea7dc275-fd39-4ce1-be1e-bc8fd0a56708 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
27242024-11-27T18:34:48.771ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:40247 req_id = ea7dc275-fd39-4ce1-be1e-bc8fd0a56708 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
27252024-11-27T18:34:48.771ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:40247 req_id = ea7dc275-fd39-4ce1-be1e-bc8fd0a56708 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
27262024-11-27T18:34:48.773ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:40247 req_id = ea7dc275-fd39-4ce1-be1e-bc8fd0a56708 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
27272024-11-27T18:34:48.773ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:40247 req_id = ea7dc275-fd39-4ce1-be1e-bc8fd0a56708 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
27282024-11-27T18:34:48.775ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:40247 req_id = ea7dc275-fd39-4ce1-be1e-bc8fd0a56708 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
27292024-11-27T18:34:48.775ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:40247 req_id = ea7dc275-fd39-4ce1-be1e-bc8fd0a56708 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
27302024-11-27T18:34:48.777ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:40247 req_id = ea7dc275-fd39-4ce1-be1e-bc8fd0a56708 roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } uri = /v1/system/silos/recovery/quotas
27312024-11-27T18:34:48.779ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:40247 req_id = ea7dc275-fd39-4ce1-be1e-bc8fd0a56708 resource = Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ByName("recovery") } result = Ok(()) uri = /v1/system/silos/recovery/quotas
27322024-11-27T18:34:48.779ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:40247 req_id = ea7dc275-fd39-4ce1-be1e-bc8fd0a56708 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
27332024-11-27T18:34:48.779ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:40247 req_id = ea7dc275-fd39-4ce1-be1e-bc8fd0a56708 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
27342024-11-27T18:34:48.781ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:40247 req_id = ea7dc275-fd39-4ce1-be1e-bc8fd0a56708 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
27352024-11-27T18:34:48.781ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:40247 req_id = ea7dc275-fd39-4ce1-be1e-bc8fd0a56708 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
27362024-11-27T18:34:48.783ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:40247 req_id = ea7dc275-fd39-4ce1-be1e-bc8fd0a56708 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
27372024-11-27T18:34:48.783ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:40247 req_id = ea7dc275-fd39-4ce1-be1e-bc8fd0a56708 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
27382024-11-27T18:34:48.786ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:40247 req_id = ea7dc275-fd39-4ce1-be1e-bc8fd0a56708 roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } uri = /v1/system/silos/recovery/quotas
27392024-11-27T18:34:48.787ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:40247 req_id = ea7dc275-fd39-4ce1-be1e-bc8fd0a56708 resource = Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ByName("recovery") } result = Ok(()) uri = /v1/system/silos/recovery/quotas
27402024-11-27T18:34:48.787ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:40247 req_id = ea7dc275-fd39-4ce1-be1e-bc8fd0a56708 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
27412024-11-27T18:34:48.787ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:40247 req_id = ea7dc275-fd39-4ce1-be1e-bc8fd0a56708 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
27422024-11-27T18:34:48.790ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47505 local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:40247 req_id = ea7dc275-fd39-4ce1-be1e-bc8fd0a56708 response_code = 200 uri = /v1/system/silos/recovery/quotas
27432024-11-27T18:34:48.791ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27442024-11-27T18:34:48.791ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27452024-11-27T18:34:48.793ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27462024-11-27T18:34:48.793ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27472024-11-27T18:34:48.794ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27482024-11-27T18:34:48.795ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "e736b427937bfa233f37989e8bdecb952a09e936", lookup_type: ByCompositeId("token = \\"e736b427937bfa233f37989e8bdecb952a09e936\\"") } result = Ok(())
27492024-11-27T18:34:48.795ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27502024-11-27T18:34:48.795ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27512024-11-27T18:34:48.796ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27522024-11-27T18:34:48.796ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27532024-11-27T18:34:48.797ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27542024-11-27T18:34:48.798ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27552024-11-27T18:34:48.798ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27562024-11-27T18:34:48.799ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27572024-11-27T18:34:48.800ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27582024-11-27T18:34:48.801ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, lookup_type: ById(0b2a0ba2-c679-4886-a1b8-ae9858bb938c) } result = Ok(())
27592024-11-27T18:34:48.801ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27602024-11-27T18:34:48.801ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27612024-11-27T18:34:48.802ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27622024-11-27T18:34:48.803ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "e736b427937bfa233f37989e8bdecb952a09e936", lookup_type: ByCompositeId("e736b427937bfa233f37989e8bdecb952a09e936") } result = Ok(())
27632024-11-27T18:34:48.803ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27642024-11-27T18:34:48.804ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27652024-11-27T18:34:48.806ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27662024-11-27T18:34:48.807ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27672024-11-27T18:34:48.808ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27682024-11-27T18:34:48.808ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27692024-11-27T18:34:48.809ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27702024-11-27T18:34:48.809ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27712024-11-27T18:34:48.810ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27722024-11-27T18:34:48.810ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27732024-11-27T18:34:48.811ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27742024-11-27T18:34:48.812ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, lookup_type: ById(0b2a0ba2-c679-4886-a1b8-ae9858bb938c) } result = Ok(())
27752024-11-27T18:34:48.812ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27762024-11-27T18:34:48.812ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27772024-11-27T18:34:48.814ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27782024-11-27T18:34:48.814ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27792024-11-27T18:34:48.815ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27802024-11-27T18:34:48.815ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27812024-11-27T18:34:48.816ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27822024-11-27T18:34:48.817ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) } result = Ok(())
27832024-11-27T18:34:48.817ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 194e08f5-5619-4182-b007-9caa5f6fda7a roles = RoleSet { roles: {} } uri = /v1/projects
27842024-11-27T18:34:48.817ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 194e08f5-5619-4182-b007-9caa5f6fda7a resource = Database result = Ok(()) uri = /v1/projects
27852024-11-27T18:34:48.819ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 194e08f5-5619-4182-b007-9caa5f6fda7a roles = RoleSet { roles: {} } uri = /v1/projects
27862024-11-27T18:34:48.819ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 194e08f5-5619-4182-b007-9caa5f6fda7a resource = Database result = Ok(()) uri = /v1/projects
27872024-11-27T18:34:48.822ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 194e08f5-5619-4182-b007-9caa5f6fda7a roles = RoleSet { roles: {} } uri = /v1/projects
27882024-11-27T18:34:48.822ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 194e08f5-5619-4182-b007-9caa5f6fda7a resource = Database result = Ok(()) uri = /v1/projects
27892024-11-27T18:34:48.824ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 194e08f5-5619-4182-b007-9caa5f6fda7a roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } uri = /v1/projects
27902024-11-27T18:34:48.826ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 194e08f5-5619-4182-b007-9caa5f6fda7a resource = Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) } result = Ok(()) uri = /v1/projects
27912024-11-27T18:34:48.826ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create
27922024-11-27T18:34:48.826ZINFOnexus (SEC): saga create dag = {"end_node":19,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[8,9,null],[9,10,null],[10,11,null],[11,12,null],[12,13,null],[13,14,null],[14,15,null],[15,16,null],[2,3,null],[16,17,null],[18,0,null],[17,19,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"project_create.project_create_record","label":"ProjectCreateRecord","name":"project"}},{"Action":{"action_name":"project_create.project_create_vpc_params","label":"ProjectCreateVpcParams","name":"vpc_create_params"}},{"SubsagaStart":{"params_node_name":"vpc_create_params","saga_name":"vpc-create"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateVpcId","name":"vpc_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateSystemRouterId","name":"system_router_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultV4RouteId","name":"default_v4_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultV6RouteId","name":"default_v6_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultSubnetId","name":"default_subnet_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultInternetGatewayId","name":"default_internet_gateway_id"}},{"Action":{"action_name":"vpc_create.vpc_create_vpc","label":"VpcCreateVpc","name":"vpc"}},{"Action":{"action_name":"vpc_create.vpc_create_router","label":"VpcCreateRouter","name":"router"}},{"Action":{"action_name":"vpc_create.vpc_create_v4_route","label":"VpcCreateV4Route","name":"route4"}},{"Action":{"action_name":"vpc_create.vpc_create_v6_route","label":"VpcCreateV6Route","name":"route6"}},{"Action":{"action_name":"vpc_create.vpc_create_subnet","label":"VpcCreateSubnet","name":"subnet"}},{"Action":{"action_name":"vpc_create.vpc_update_firewall","label":"VpcUpdateFirewall","name":"firewall"}},{"Action":{"action_name":"vpc_create.vpc_create_gateway","label":"VpcCreateGateway","name":"gateway"}},{"Action":{"action_name":"vpc_create.vpc_notify_sleds","label":"VpcNotifySleds","name":"no_result"}},{"SubsagaEnd":{"name":"vpc"}},{"Start":{"params":{"authz_silo":{"key":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","lookup_type":{"ById":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba"},"parent":null},"project_create":{"description":"","name":"proj-752edbda008"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","silo_user_id":"0b2a0ba2-c679-4886-a1b8-ae9858bb938c"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"project-create","start_node":18} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
27932024-11-27T18:34:48.826ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create
27942024-11-27T18:34:48.862ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create
27952024-11-27T18:34:48.862ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
27962024-11-27T18:34:48.862ZDEBGnexus (SEC): saga log event new_state = N018 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
27972024-11-27T18:34:48.862ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 18 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
27982024-11-27T18:34:48.865ZDEBGnexus (SEC): saga log event new_state = N018 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
27992024-11-27T18:34:48.865ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 18 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
28002024-11-27T18:34:48.871ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
28012024-11-27T18:34:48.871ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
28022024-11-27T18:34:48.875ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = ProjectCreateRecord
28032024-11-27T18:34:48.876ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = ProjectCreateRecord
28042024-11-27T18:34:48.878ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = ProjectCreateRecord
28052024-11-27T18:34:48.878ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = ProjectCreateRecord
28062024-11-27T18:34:48.881ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = ProjectCreateRecord
28072024-11-27T18:34:48.881ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = ProjectCreateRecord
28082024-11-27T18:34:48.882ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = ProjectCreateRecord
28092024-11-27T18:34:48.884ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) } result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = ProjectCreateRecord
28102024-11-27T18:34:48.884ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = ProjectCreateRecord
28112024-11-27T18:34:48.884ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = ProjectCreateRecord
28122024-11-27T18:34:48.898ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
28132024-11-27T18:34:48.898ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba"), "lookup_type": Object {"ByName": String("proj-752edbda008")}, "parent": Object {"key": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba"), "lookup_type": Object {"ById": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba")}, "parent": Null}}, Object {"identity": Object {"description": String(""), "id": String("1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba"), "name": String("proj-752edbda008"), "time_created": String("2024-11-27T18:34:48.875838Z"), "time_deleted": Null, "time_modified": String("2024-11-27T18:34:48.875838Z")}, "rcgen": Number(1), "silo_id": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba")}]) node_id = 0 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
28142024-11-27T18:34:48.902ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
28152024-11-27T18:34:48.902ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
28162024-11-27T18:34:48.915ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
28172024-11-27T18:34:48.915ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"authz_project": Object {"key": String("1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba"), "lookup_type": Object {"ByName": String("proj-752edbda008")}, "parent": Object {"key": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba"), "lookup_type": Object {"ById": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba"), "silo_user_id": String("0b2a0ba2-c679-4886-a1b8-ae9858bb938c")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd21:d4be:2069::/48"), "name": String("default")}}) node_id = 1 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
28182024-11-27T18:34:48.919ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
28192024-11-27T18:34:48.919ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
28202024-11-27T18:34:48.921ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
28212024-11-27T18:34:48.921ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
28222024-11-27T18:34:48.924ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
28232024-11-27T18:34:48.924ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
28242024-11-27T18:34:48.927ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
28252024-11-27T18:34:48.927ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("c95295a8-b909-41a6-ac8c-0f3016565054")) node_id = 3 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
28262024-11-27T18:34:48.930ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
28272024-11-27T18:34:48.930ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
28282024-11-27T18:34:48.933ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
28292024-11-27T18:34:48.933ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("6fead121-f52b-4251-93b3-a9d36fbbe9c4")) node_id = 4 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
28302024-11-27T18:34:48.936ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
28312024-11-27T18:34:48.936ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
28322024-11-27T18:34:48.938ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
28332024-11-27T18:34:48.938ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("271203b0-d28e-4f46-83c1-8e2f13acc38d")) node_id = 5 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
28342024-11-27T18:34:48.941ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
28352024-11-27T18:34:48.941ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
28362024-11-27T18:34:48.944ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
28372024-11-27T18:34:48.944ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("b8eaa7c6-1a9c-4d77-a078-0d1cb15a7f13")) node_id = 6 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
28382024-11-27T18:34:48.947ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
28392024-11-27T18:34:48.947ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
28402024-11-27T18:34:48.949ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
28412024-11-27T18:34:48.949ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("11a84d5b-ffe8-4a54-89f4-11e668422030")) node_id = 7 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
28422024-11-27T18:34:48.953ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
28432024-11-27T18:34:48.953ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
28442024-11-27T18:34:48.955ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
28452024-11-27T18:34:48.955ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("4f5e1f4e-91dc-40d1-82ea-bcf7ee9998c4")) node_id = 8 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
28462024-11-27T18:34:48.958ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
28472024-11-27T18:34:48.958ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
28482024-11-27T18:34:48.963ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateVpc
28492024-11-27T18:34:48.963ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateVpc
28502024-11-27T18:34:48.965ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateVpc
28512024-11-27T18:34:48.965ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateVpc
28522024-11-27T18:34:48.968ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateVpc
28532024-11-27T18:34:48.968ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateVpc
28542024-11-27T18:34:48.970ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateVpc
28552024-11-27T18:34:48.970ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateVpc
28562024-11-27T18:34:48.973ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateVpc
28572024-11-27T18:34:48.975ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba, lookup_type: ByName("proj-752edbda008") } result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateVpc
28582024-11-27T18:34:48.975ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateVpc
28592024-11-27T18:34:48.975ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateVpc
28602024-11-27T18:34:48.985ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
28612024-11-27T18:34:48.985ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("c95295a8-b909-41a6-ac8c-0f3016565054"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba"), "lookup_type": Object {"ByName": String("proj-752edbda008")}, "parent": Object {"key": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba"), "lookup_type": Object {"ById": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba")}, "parent": Null}}}, Object {"dns_name": String("default"), "firewall_gen": Number(1), "identity": Object {"description": String("Default VPC"), "id": String("c95295a8-b909-41a6-ac8c-0f3016565054"), "name": String("default"), "time_created": String("2024-11-27T18:34:48.963520Z"), "time_deleted": Null, "time_modified": String("2024-11-27T18:34:48.963520Z")}, "ipv6_prefix": String("fd21:d4be:2069::/48"), "project_id": String("1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba"), "subnet_gen": Number(1), "system_router_id": String("6fead121-f52b-4251-93b3-a9d36fbbe9c4"), "vni": Number(5320748)}]) node_id = 9 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
28622024-11-27T18:34:48.988ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
28632024-11-27T18:34:48.988ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
28642024-11-27T18:34:48.991ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateRouter
28652024-11-27T18:34:48.991ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateRouter
28662024-11-27T18:34:48.993ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateRouter
28672024-11-27T18:34:48.993ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateRouter
28682024-11-27T18:34:48.996ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateRouter
28692024-11-27T18:34:48.996ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateRouter
28702024-11-27T18:34:48.998ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateRouter
28712024-11-27T18:34:48.998ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateRouter
28722024-11-27T18:34:49.000ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateRouter
28732024-11-27T18:34:49.002ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba, lookup_type: ByName("proj-752edbda008") }, key: c95295a8-b909-41a6-ac8c-0f3016565054, lookup_type: ByName("default") } result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateRouter
28742024-11-27T18:34:49.002ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateRouter
28752024-11-27T18:34:49.002ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateRouter
28762024-11-27T18:34:49.033ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
28772024-11-27T18:34:49.033ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"key": String("6fead121-f52b-4251-93b3-a9d36fbbe9c4"), "lookup_type": Object {"ById": String("6fead121-f52b-4251-93b3-a9d36fbbe9c4")}, "parent": Object {"key": String("c95295a8-b909-41a6-ac8c-0f3016565054"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba"), "lookup_type": Object {"ByName": String("proj-752edbda008")}, "parent": Object {"key": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba"), "lookup_type": Object {"ById": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba")}, "parent": Null}}}}) node_id = 10 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
28782024-11-27T18:34:49.036ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
28792024-11-27T18:34:49.036ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
28802024-11-27T18:34:49.039ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateV4Route
28812024-11-27T18:34:49.040ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateV4Route
28822024-11-27T18:34:49.042ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateV4Route
28832024-11-27T18:34:49.042ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateV4Route
28842024-11-27T18:34:49.043ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateV4Route
28852024-11-27T18:34:49.044ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateV4Route
28862024-11-27T18:34:49.046ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateV4Route
28872024-11-27T18:34:49.046ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateV4Route
28882024-11-27T18:34:49.048ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateV4Route
28892024-11-27T18:34:49.052ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba, lookup_type: ByName("proj-752edbda008") }, key: c95295a8-b909-41a6-ac8c-0f3016565054, lookup_type: ByName("default") }, key: 6fead121-f52b-4251-93b3-a9d36fbbe9c4, lookup_type: ById(6fead121-f52b-4251-93b3-a9d36fbbe9c4) } result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateV4Route
28902024-11-27T18:34:49.052ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateV4Route
28912024-11-27T18:34:49.052ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateV4Route
28922024-11-27T18:34:49.061ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
28932024-11-27T18:34:49.061ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
28942024-11-27T18:34:49.064ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
28952024-11-27T18:34:49.064ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
28962024-11-27T18:34:49.066ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateV6Route
28972024-11-27T18:34:49.066ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateV6Route
28982024-11-27T18:34:49.068ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateV6Route
28992024-11-27T18:34:49.068ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateV6Route
29002024-11-27T18:34:49.070ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateV6Route
29012024-11-27T18:34:49.071ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateV6Route
29022024-11-27T18:34:49.073ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateV6Route
29032024-11-27T18:34:49.073ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateV6Route
29042024-11-27T18:34:49.075ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateV6Route
29052024-11-27T18:34:49.079ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba, lookup_type: ByName("proj-752edbda008") }, key: c95295a8-b909-41a6-ac8c-0f3016565054, lookup_type: ByName("default") }, key: 6fead121-f52b-4251-93b3-a9d36fbbe9c4, lookup_type: ById(6fead121-f52b-4251-93b3-a9d36fbbe9c4) } result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateV6Route
29062024-11-27T18:34:49.079ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateV6Route
29072024-11-27T18:34:49.079ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateV6Route
29082024-11-27T18:34:49.115ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
29092024-11-27T18:34:49.115ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
29102024-11-27T18:34:49.118ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
29112024-11-27T18:34:49.118ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
29122024-11-27T18:34:49.122ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateSubnet
29132024-11-27T18:34:49.122ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateSubnet
29142024-11-27T18:34:49.124ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateSubnet
29152024-11-27T18:34:49.125ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateSubnet
29162024-11-27T18:34:49.127ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateSubnet
29172024-11-27T18:34:49.127ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateSubnet
29182024-11-27T18:34:49.129ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateSubnet
29192024-11-27T18:34:49.129ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateSubnet
29202024-11-27T18:34:49.131ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateSubnet
29212024-11-27T18:34:49.134ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba, lookup_type: ByName("proj-752edbda008") }, key: c95295a8-b909-41a6-ac8c-0f3016565054, lookup_type: ByName("default") } result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateSubnet
29222024-11-27T18:34:49.147ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateSubnet
29232024-11-27T18:34:49.147ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateSubnet
29242024-11-27T18:34:49.162ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateSubnet
29252024-11-27T18:34:49.162ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateSubnet
29262024-11-27T18:34:49.166ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
29272024-11-27T18:34:49.166ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("11a84d5b-ffe8-4a54-89f4-11e668422030"), "lookup_type": Object {"ById": String("11a84d5b-ffe8-4a54-89f4-11e668422030")}, "parent": Object {"key": String("c95295a8-b909-41a6-ac8c-0f3016565054"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba"), "lookup_type": Object {"ByName": String("proj-752edbda008")}, "parent": Object {"key": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba"), "lookup_type": Object {"ById": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("11a84d5b-ffe8-4a54-89f4-11e668422030"), "name": String("default"), "time_created": String("2024-11-27T18:34:49.122096Z"), "time_deleted": Null, "time_modified": String("2024-11-27T18:34:49.122096Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd21:d4be:2069::/64"), "rcgen": Number(1), "vpc_id": String("c95295a8-b909-41a6-ac8c-0f3016565054")}]) node_id = 13 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
29282024-11-27T18:34:49.169ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
29292024-11-27T18:34:49.169ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
29302024-11-27T18:34:49.172ZDEBGnexus: default firewall rules for vpc default rules = [VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: 319b728c-b686-4afb-9b68-d90820a57489, name: Name(Name("allow-internal-inbound")), description: "allow inbound traffic to all instances within the VPC if originated within the VPC", time_created: 2024-11-27T18:34:49.172876407Z, time_modified: 2024-11-27T18:34:49.172876407Z, time_deleted: None }, vpc_id: c95295a8-b909-41a6-ac8c-0f3016565054, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: Some([VpcFirewallRuleHostFilter(Vpc(Name("default")))]), filter_ports: None, filter_protocols: None, action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }, VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: 2b8f47dd-8b64-4820-bbd3-c97325b01bbf, name: Name(Name("allow-ssh")), description: "allow inbound TCP connections on port 22 from anywhere", time_created: 2024-11-27T18:34:49.172878397Z, time_modified: 2024-11-27T18:34:49.172878397Z, time_deleted: None }, vpc_id: c95295a8-b909-41a6-ac8c-0f3016565054, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: None, filter_ports: Some([L4PortRange(L4PortRange { first: L4Port(22), last: L4Port(22) })]), filter_protocols: Some([VpcFirewallRuleProtocol(Tcp)]), action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }, VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: aeae3b82-4d50-4ac8-9b7c-f45d96bcf95f, name: Name(Name("allow-icmp")), description: "allow inbound ICMP traffic from anywhere", time_created: 2024-11-27T18:34:49.172879317Z, time_modified: 2024-11-27T18:34:49.172879317Z, time_deleted: None }, vpc_id: c95295a8-b909-41a6-ac8c-0f3016565054, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: None, filter_ports: None, filter_protocols: Some([VpcFirewallRuleProtocol(Icmp)]), action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }]
29312024-11-27T18:34:49.172ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcUpdateFirewall
29322024-11-27T18:34:49.173ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcUpdateFirewall
29332024-11-27T18:34:49.175ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcUpdateFirewall
29342024-11-27T18:34:49.175ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcUpdateFirewall
29352024-11-27T18:34:49.177ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcUpdateFirewall
29362024-11-27T18:34:49.178ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcUpdateFirewall
29372024-11-27T18:34:49.180ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcUpdateFirewall
29382024-11-27T18:34:49.180ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcUpdateFirewall
29392024-11-27T18:34:49.182ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcUpdateFirewall
29402024-11-27T18:34:49.184ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba, lookup_type: ByName("proj-752edbda008") }, key: c95295a8-b909-41a6-ac8c-0f3016565054, lookup_type: ByName("default") } result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcUpdateFirewall
29412024-11-27T18:34:49.184ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcUpdateFirewall
29422024-11-27T18:34:49.184ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcUpdateFirewall
29432024-11-27T18:34:49.235ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
29442024-11-27T18:34:49.235ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("319b728c-b686-4afb-9b68-d90820a57489"), "name": String("allow-internal-inbound"), "time_created": String("2024-11-27T18:34:49.172876407Z"), "time_deleted": Null, "time_modified": String("2024-11-27T18:34:49.172876407Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("c95295a8-b909-41a6-ac8c-0f3016565054")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [String("TCP")], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("2b8f47dd-8b64-4820-bbd3-c97325b01bbf"), "name": String("allow-ssh"), "time_created": String("2024-11-27T18:34:49.172878397Z"), "time_deleted": Null, "time_modified": String("2024-11-27T18:34:49.172878397Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("c95295a8-b909-41a6-ac8c-0f3016565054")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [String("ICMP")], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("aeae3b82-4d50-4ac8-9b7c-f45d96bcf95f"), "name": String("allow-icmp"), "time_created": String("2024-11-27T18:34:49.172879317Z"), "time_deleted": Null, "time_modified": String("2024-11-27T18:34:49.172879317Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("c95295a8-b909-41a6-ac8c-0f3016565054")}]) node_id = 14 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
29452024-11-27T18:34:49.239ZDEBGnexus (SEC): saga log event new_state = N015 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
29462024-11-27T18:34:49.239ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 15 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
29472024-11-27T18:34:49.242ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateGateway
29482024-11-27T18:34:49.243ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateGateway
29492024-11-27T18:34:49.245ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateGateway
29502024-11-27T18:34:49.245ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateGateway
29512024-11-27T18:34:49.246ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateGateway
29522024-11-27T18:34:49.247ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateGateway
29532024-11-27T18:34:49.249ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateGateway
29542024-11-27T18:34:49.249ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateGateway
29552024-11-27T18:34:49.251ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateGateway
29562024-11-27T18:34:49.254ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba, lookup_type: ByName("proj-752edbda008") }, key: c95295a8-b909-41a6-ac8c-0f3016565054, lookup_type: ByName("default") } result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateGateway
29572024-11-27T18:34:49.254ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateGateway
29582024-11-27T18:34:49.254ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateGateway
29592024-11-27T18:34:49.257ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateGateway
29602024-11-27T18:34:49.258ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateGateway
29612024-11-27T18:34:49.261ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateGateway
29622024-11-27T18:34:49.262ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateGateway
29632024-11-27T18:34:49.264ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateGateway
29642024-11-27T18:34:49.264ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateGateway
29652024-11-27T18:34:49.267ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateGateway
29662024-11-27T18:34:49.267ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateGateway
29672024-11-27T18:34:49.269ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateGateway
29682024-11-27T18:34:49.269ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateGateway
29692024-11-27T18:34:49.272ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateGateway
29702024-11-27T18:34:49.272ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateGateway
29712024-11-27T18:34:49.274ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateGateway
29722024-11-27T18:34:49.277ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba, lookup_type: ByName("proj-752edbda008") }, key: c95295a8-b909-41a6-ac8c-0f3016565054, lookup_type: ByName("default") }, key: 4f5e1f4e-91dc-40d1-82ea-bcf7ee9998c4, lookup_type: ById(4f5e1f4e-91dc-40d1-82ea-bcf7ee9998c4) } result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateGateway
29732024-11-27T18:34:49.277ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateGateway
29742024-11-27T18:34:49.277ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcCreateGateway
29752024-11-27T18:34:49.283ZDEBGnexus (SEC): saga log event new_state = N015 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
29762024-11-27T18:34:49.283ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"key": String("4f5e1f4e-91dc-40d1-82ea-bcf7ee9998c4"), "lookup_type": Object {"ById": String("4f5e1f4e-91dc-40d1-82ea-bcf7ee9998c4")}, "parent": Object {"key": String("c95295a8-b909-41a6-ac8c-0f3016565054"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba"), "lookup_type": Object {"ByName": String("proj-752edbda008")}, "parent": Object {"key": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba"), "lookup_type": Object {"ById": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba")}, "parent": Null}}}}) node_id = 15 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
29772024-11-27T18:34:49.286ZDEBGnexus (SEC): saga log event new_state = N016 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
29782024-11-27T18:34:49.286ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 16 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
29792024-11-27T18:34:49.289ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcNotifySleds
29802024-11-27T18:34:49.290ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcNotifySleds
29812024-11-27T18:34:49.291ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcNotifySleds
29822024-11-27T18:34:49.291ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcNotifySleds
29832024-11-27T18:34:49.292ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcNotifySleds
29842024-11-27T18:34:49.292ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcNotifySleds
29852024-11-27T18:34:49.294ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcNotifySleds
29862024-11-27T18:34:49.294ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcNotifySleds
29872024-11-27T18:34:49.296ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcNotifySleds
29882024-11-27T18:34:49.296ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcNotifySleds
29892024-11-27T18:34:49.298ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcNotifySleds
29902024-11-27T18:34:49.299ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcNotifySleds
29912024-11-27T18:34:49.301ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcNotifySleds
29922024-11-27T18:34:49.301ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcNotifySleds
29932024-11-27T18:34:49.303ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcNotifySleds
29942024-11-27T18:34:49.306ZDEBGnexus (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba, lookup_type: ById(1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba) }, key: c95295a8-b909-41a6-ac8c-0f3016565054, lookup_type: ByName("default") } result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcNotifySleds
29952024-11-27T18:34:49.306ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcNotifySleds
29962024-11-27T18:34:49.307ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcNotifySleds
29972024-11-27T18:34:49.308ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcNotifySleds
29982024-11-27T18:34:49.308ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcNotifySleds
29992024-11-27T18:34:49.310ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcNotifySleds
30002024-11-27T18:34:49.310ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcNotifySleds
30012024-11-27T18:34:49.312ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcNotifySleds
30022024-11-27T18:34:49.313ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcNotifySleds
30032024-11-27T18:34:49.315ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcNotifySleds
30042024-11-27T18:34:49.318ZDEBGnexus (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba, lookup_type: ById(1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba) }, key: c95295a8-b909-41a6-ac8c-0f3016565054, lookup_type: ByName("default") } result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcNotifySleds
30052024-11-27T18:34:49.318ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcNotifySleds
30062024-11-27T18:34:49.318ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_node = VpcNotifySleds
30072024-11-27T18:34:49.323ZDEBGnexus: resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {} subnet_networks = {} vpc_interfaces = {}
30082024-11-27T18:34:49.323ZDEBGnexus: resolved firewall rules for sled agents sled_agent_rules = []
30092024-11-27T18:34:49.323ZDEBGnexus: resolved 0 rules for sleds
30102024-11-27T18:34:49.347ZDEBGnexus: resolved sleds for vpc default vpc_to_sled = []
30112024-11-27T18:34:49.347ZDEBGnexus: sending firewall rules to sled agents
30122024-11-27T18:34:49.347ZINFOnexus: updated firewall rules on 0 sleds file = nexus/networking/src/firewall_rules.rs:496
30132024-11-27T18:34:49.347ZDEBGnexus (SEC): saga log event new_state = N016 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
30142024-11-27T18:34:49.347ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 16 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
30152024-11-27T18:34:49.350ZDEBGnexus (SEC): saga log event new_state = N017 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
30162024-11-27T18:34:49.350ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 17 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
30172024-11-27T18:34:49.353ZDEBGnexus (SEC): saga log event new_state = N017 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
30182024-11-27T18:34:49.353ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 17 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
30192024-11-27T18:34:49.357ZDEBGnexus (SEC): saga log event new_state = N019 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
30202024-11-27T18:34:49.357ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 19 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
30212024-11-27T18:34:49.359ZDEBGnexus (SEC): saga log event new_state = N019 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
30222024-11-27T18:34:49.359ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 19 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
30232024-11-27T18:34:49.362ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
30242024-11-27T18:34:49.362ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
30252024-11-27T18:34:49.408ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
30262024-11-27T18:34:49.408ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c saga_name = project-create saga_result = SagaResult { saga_id: fe9ecd40-e26f-42da-8112-4fe24375259c, saga_log: SagaLog { saga_id: fe9ecd40-e26f-42da-8112-4fe24375259c, unwinding: false, events: [N018 started, N018 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N013 started, N013 succeeded, N014 started, N014 succeeded, N015 started, N015 succeeded, N016 started, N016 succeeded, N017 started, N017 succeeded, N019 started, N019 succeeded], node_status: {0: Succeeded(Array [Object {"key": String("1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba"), "lookup_type": Object {"ByName": String("proj-752edbda008")}, "parent": Object {"key": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba"), "lookup_type": Object {"ById": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba")}, "parent": Null}}, Object {"identity": Object {"description": String(""), "id": String("1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba"), "name": String("proj-752edbda008"), "time_created": String("2024-11-27T18:34:48.875838Z"), "time_deleted": Null, "time_modified": String("2024-11-27T18:34:48.875838Z")}, "rcgen": Number(1), "silo_id": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba")}]), 1: Succeeded(Object {"authz_project": Object {"key": String("1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba"), "lookup_type": Object {"ByName": String("proj-752edbda008")}, "parent": Object {"key": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba"), "lookup_type": Object {"ById": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba"), "silo_user_id": String("0b2a0ba2-c679-4886-a1b8-ae9858bb938c")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd21:d4be:2069::/48"), "name": String("default")}}), 2: Succeeded(Null), 3: Succeeded(String("c95295a8-b909-41a6-ac8c-0f3016565054")), 4: Succeeded(String("6fead121-f52b-4251-93b3-a9d36fbbe9c4")), 5: Succeeded(String("271203b0-d28e-4f46-83c1-8e2f13acc38d")), 6: Succeeded(String("b8eaa7c6-1a9c-4d77-a078-0d1cb15a7f13")), 7: Succeeded(String("11a84d5b-ffe8-4a54-89f4-11e668422030")), 8: Succeeded(String("4f5e1f4e-91dc-40d1-82ea-bcf7ee9998c4")), 9: Succeeded(Array [Object {"key": String("c95295a8-b909-41a6-ac8c-0f3016565054"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba"), "lookup_type": Object {"ByName": String("proj-752edbda008")}, "parent": Object {"key": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba"), "lookup_type": Object {"ById": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba")}, "parent": Null}}}, Object {"dns_name": String("default"), "firewall_gen": Number(1), "identity": Object {"description": String("Default VPC"), "id": String("c95295a8-b909-41a6-ac8c-0f3016565054"), "name": String("default"), "time_created": String("2024-11-27T18:34:48.963520Z"), "time_deleted": Null, "time_modified": String("2024-11-27T18:34:48.963520Z")}, "ipv6_prefix": String("fd21:d4be:2069::/48"), "project_id": String("1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba"), "subnet_gen": Number(1), "system_router_id": String("6fead121-f52b-4251-93b3-a9d36fbbe9c4"), "vni": Number(5320748)}]), 10: Succeeded(Object {"key": String("6fead121-f52b-4251-93b3-a9d36fbbe9c4"), "lookup_type": Object {"ById": String("6fead121-f52b-4251-93b3-a9d36fbbe9c4")}, "parent": Object {"key": String("c95295a8-b909-41a6-ac8c-0f3016565054"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba"), "lookup_type": Object {"ByName": String("proj-752edbda008")}, "parent": Object {"key": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba"), "lookup_type": Object {"ById": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba")}, "parent": Null}}}}), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Array [Object {"key": String("11a84d5b-ffe8-4a54-89f4-11e668422030"), "lookup_type": Object {"ById": String("11a84d5b-ffe8-4a54-89f4-11e668422030")}, "parent": Object {"key": String("c95295a8-b909-41a6-ac8c-0f3016565054"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba"), "lookup_type": Object {"ByName": String("proj-752edbda008")}, "parent": Object {"key": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba"), "lookup_type": Object {"ById": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("11a84d5b-ffe8-4a54-89f4-11e668422030"), "name": String("default"), "time_created": String("2024-11-27T18:34:49.122096Z"), "time_deleted": Null, "time_modified": String("2024-11-27T18:34:49.122096Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd21:d4be:2069::/64"), "rcgen": Number(1), "vpc_id": String("c95295a8-b909-41a6-ac8c-0f3016565054")}]), 14: Succeeded(Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("319b728c-b686-4afb-9b68-d90820a57489"), "name": String("allow-internal-inbound"), "time_created": String("2024-11-27T18:34:49.172876407Z"), "time_deleted": Null, "time_modified": String("2024-11-27T18:34:49.172876407Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("c95295a8-b909-41a6-ac8c-0f3016565054")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [String("TCP")], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("2b8f47dd-8b64-4820-bbd3-c97325b01bbf"), "name": String("allow-ssh"), "time_created": String("2024-11-27T18:34:49.172878397Z"), "time_deleted": Null, "time_modified": String("2024-11-27T18:34:49.172878397Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("c95295a8-b909-41a6-ac8c-0f3016565054")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [String("ICMP")], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("aeae3b82-4d50-4ac8-9b7c-f45d96bcf95f"), "name": String("allow-icmp"), "time_created": String("2024-11-27T18:34:49.172879317Z"), "time_deleted": Null, "time_modified": String("2024-11-27T18:34:49.172879317Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("c95295a8-b909-41a6-ac8c-0f3016565054")}]), 15: Succeeded(Object {"key": String("4f5e1f4e-91dc-40d1-82ea-bcf7ee9998c4"), "lookup_type": Object {"ById": String("4f5e1f4e-91dc-40d1-82ea-bcf7ee9998c4")}, "parent": Object {"key": String("c95295a8-b909-41a6-ac8c-0f3016565054"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba"), "lookup_type": Object {"ByName": String("proj-752edbda008")}, "parent": Object {"key": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba"), "lookup_type": Object {"ById": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba")}, "parent": Null}}}}), 16: Succeeded(Null), 17: Succeeded(Null), 18: Succeeded(Null), 19: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"default_internet_gateway_id": String("4f5e1f4e-91dc-40d1-82ea-bcf7ee9998c4"), "default_subnet_id": String("11a84d5b-ffe8-4a54-89f4-11e668422030"), "default_v4_route_id": String("271203b0-d28e-4f46-83c1-8e2f13acc38d"), "default_v6_route_id": String("b8eaa7c6-1a9c-4d77-a078-0d1cb15a7f13"), "firewall": Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("319b728c-b686-4afb-9b68-d90820a57489"), "name": String("allow-internal-inbound"), "time_created": String("2024-11-27T18:34:49.172876407Z"), "time_deleted": Null, "time_modified": String("2024-11-27T18:34:49.172876407Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("c95295a8-b909-41a6-ac8c-0f3016565054")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [String("TCP")], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("2b8f47dd-8b64-4820-bbd3-c97325b01bbf"), "name": String("allow-ssh"), "time_created": String("2024-11-27T18:34:49.172878397Z"), "time_deleted": Null, "time_modified": String("2024-11-27T18:34:49.172878397Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("c95295a8-b909-41a6-ac8c-0f3016565054")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [String("ICMP")], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("aeae3b82-4d50-4ac8-9b7c-f45d96bcf95f"), "name": String("allow-icmp"), "time_created": String("2024-11-27T18:34:49.172879317Z"), "time_deleted": Null, "time_modified": String("2024-11-27T18:34:49.172879317Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("c95295a8-b909-41a6-ac8c-0f3016565054")}], "gateway": Object {"key": String("4f5e1f4e-91dc-40d1-82ea-bcf7ee9998c4"), "lookup_type": Object {"ById": String("4f5e1f4e-91dc-40d1-82ea-bcf7ee9998c4")}, "parent": Object {"key": String("c95295a8-b909-41a6-ac8c-0f3016565054"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba"), "lookup_type": Object {"ByName": String("proj-752edbda008")}, "parent": Object {"key": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba"), "lookup_type": Object {"ById": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba")}, "parent": Null}}}}, "no_result": Null, "project": Array [Object {"key": String("1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba"), "lookup_type": Object {"ByName": String("proj-752edbda008")}, "parent": Object {"key": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba"), "lookup_type": Object {"ById": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba")}, "parent": Null}}, Object {"identity": Object {"description": String(""), "id": String("1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba"), "name": String("proj-752edbda008"), "time_created": String("2024-11-27T18:34:48.875838Z"), "time_deleted": Null, "time_modified": String("2024-11-27T18:34:48.875838Z")}, "rcgen": Number(1), "silo_id": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba")}], "route4": Null, "route6": Null, "router": Object {"key": String("6fead121-f52b-4251-93b3-a9d36fbbe9c4"), "lookup_type": Object {"ById": String("6fead121-f52b-4251-93b3-a9d36fbbe9c4")}, "parent": Object {"key": String("c95295a8-b909-41a6-ac8c-0f3016565054"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba"), "lookup_type": Object {"ByName": String("proj-752edbda008")}, "parent": Object {"key": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba"), "lookup_type": Object {"ById": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba")}, "parent": Null}}}}, "subnet": Array [Object {"key": String("11a84d5b-ffe8-4a54-89f4-11e668422030"), "lookup_type": Object {"ById": String("11a84d5b-ffe8-4a54-89f4-11e668422030")}, "parent": Object {"key": String("c95295a8-b909-41a6-ac8c-0f3016565054"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba"), "lookup_type": Object {"ByName": String("proj-752edbda008")}, "parent": Object {"key": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba"), "lookup_type": Object {"ById": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("11a84d5b-ffe8-4a54-89f4-11e668422030"), "name": String("default"), "time_created": String("2024-11-27T18:34:49.122096Z"), "time_deleted": Null, "time_modified": String("2024-11-27T18:34:49.122096Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd21:d4be:2069::/64"), "rcgen": Number(1), "vpc_id": String("c95295a8-b909-41a6-ac8c-0f3016565054")}], "system_router_id": String("6fead121-f52b-4251-93b3-a9d36fbbe9c4"), "vpc": Null, "vpc_create_params": Object {"authz_project": Object {"key": String("1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba"), "lookup_type": Object {"ByName": String("proj-752edbda008")}, "parent": Object {"key": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba"), "lookup_type": Object {"ById": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba"), "silo_user_id": String("0b2a0ba2-c679-4886-a1b8-ae9858bb938c")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd21:d4be:2069::/48"), "name": String("default")}}, "vpc_id": String("c95295a8-b909-41a6-ac8c-0f3016565054")} }) }
30272024-11-27T18:34:49.408ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 616798 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 194e08f5-5619-4182-b007-9caa5f6fda7a response_code = 201 uri = /v1/projects
30282024-11-27T18:34:49.413ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30292024-11-27T18:34:49.413ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30302024-11-27T18:34:49.414ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30312024-11-27T18:34:49.414ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30322024-11-27T18:34:49.416ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30332024-11-27T18:34:49.417ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "e736b427937bfa233f37989e8bdecb952a09e936", lookup_type: ByCompositeId("token = \\"e736b427937bfa233f37989e8bdecb952a09e936\\"") } result = Ok(())
30342024-11-27T18:34:49.417ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30352024-11-27T18:34:49.417ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30362024-11-27T18:34:49.418ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30372024-11-27T18:34:49.419ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30382024-11-27T18:34:49.420ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30392024-11-27T18:34:49.420ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30402024-11-27T18:34:49.421ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30412024-11-27T18:34:49.422ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30422024-11-27T18:34:49.423ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30432024-11-27T18:34:49.424ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, lookup_type: ById(0b2a0ba2-c679-4886-a1b8-ae9858bb938c) } result = Ok(())
30442024-11-27T18:34:49.424ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30452024-11-27T18:34:49.424ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30462024-11-27T18:34:49.426ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30472024-11-27T18:34:49.427ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "e736b427937bfa233f37989e8bdecb952a09e936", lookup_type: ByCompositeId("e736b427937bfa233f37989e8bdecb952a09e936") } result = Ok(())
30482024-11-27T18:34:49.427ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30492024-11-27T18:34:49.427ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30502024-11-27T18:34:49.430ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30512024-11-27T18:34:49.431ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30522024-11-27T18:34:49.432ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30532024-11-27T18:34:49.432ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30542024-11-27T18:34:49.433ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30552024-11-27T18:34:49.434ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30562024-11-27T18:34:49.435ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30572024-11-27T18:34:49.435ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30582024-11-27T18:34:49.437ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30592024-11-27T18:34:49.438ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, lookup_type: ById(0b2a0ba2-c679-4886-a1b8-ae9858bb938c) } result = Ok(())
30602024-11-27T18:34:49.438ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30612024-11-27T18:34:49.438ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30622024-11-27T18:34:49.439ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30632024-11-27T18:34:49.439ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30642024-11-27T18:34:49.440ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30652024-11-27T18:34:49.440ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30662024-11-27T18:34:49.442ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30672024-11-27T18:34:49.443ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) } result = Ok(())
30682024-11-27T18:34:49.443ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 060a609c-b6d1-4a85-ae15-a008edf495f1 roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-752edbda008
30692024-11-27T18:34:49.443ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 060a609c-b6d1-4a85-ae15-a008edf495f1 resource = Database result = Ok(()) uri = /v1/disks?project=proj-752edbda008
30702024-11-27T18:34:49.444ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 060a609c-b6d1-4a85-ae15-a008edf495f1 roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-752edbda008
30712024-11-27T18:34:49.445ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 060a609c-b6d1-4a85-ae15-a008edf495f1 resource = Database result = Ok(()) uri = /v1/disks?project=proj-752edbda008
30722024-11-27T18:34:49.447ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 060a609c-b6d1-4a85-ae15-a008edf495f1 roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-752edbda008
30732024-11-27T18:34:49.447ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 060a609c-b6d1-4a85-ae15-a008edf495f1 resource = Database result = Ok(()) uri = /v1/disks?project=proj-752edbda008
30742024-11-27T18:34:49.449ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 060a609c-b6d1-4a85-ae15-a008edf495f1 roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-752edbda008
30752024-11-27T18:34:49.449ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 060a609c-b6d1-4a85-ae15-a008edf495f1 resource = Database result = Ok(()) uri = /v1/disks?project=proj-752edbda008
30762024-11-27T18:34:49.451ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 060a609c-b6d1-4a85-ae15-a008edf495f1 roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-752edbda008
30772024-11-27T18:34:49.451ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 060a609c-b6d1-4a85-ae15-a008edf495f1 resource = Database result = Ok(()) uri = /v1/disks?project=proj-752edbda008
30782024-11-27T18:34:49.454ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 060a609c-b6d1-4a85-ae15-a008edf495f1 roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-752edbda008
30792024-11-27T18:34:49.454ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 060a609c-b6d1-4a85-ae15-a008edf495f1 resource = Database result = Ok(()) uri = /v1/disks?project=proj-752edbda008
30802024-11-27T18:34:49.456ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 060a609c-b6d1-4a85-ae15-a008edf495f1 roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } uri = /v1/disks?project=proj-752edbda008
30812024-11-27T18:34:49.458ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 060a609c-b6d1-4a85-ae15-a008edf495f1 resource = Project { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba, lookup_type: ByName("proj-752edbda008") } result = Ok(()) uri = /v1/disks?project=proj-752edbda008
30822024-11-27T18:34:49.458ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create
30832024-11-27T18:34:49.458ZINFOnexus (SEC): saga create dag = {"end_node":10,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,0,null],[8,10,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateDiskId","name":"disk_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateVolumeId","name":"volume_id"}},{"Action":{"action_name":"disk_create.create_disk_record","label":"CreateDiskRecord","name":"created_disk"}},{"Action":{"action_name":"disk_create.regions_alloc","label":"RegionsAlloc","name":"datasets_and_regions"}},{"Action":{"action_name":"disk_create.space_account","label":"SpaceAccount","name":"no_result"}},{"Action":{"action_name":"disk_create.regions_ensure_undo","label":"RegionsEnsureUndo","name":"regions_ensure_undo"}},{"Action":{"action_name":"disk_create.regions_ensure","label":"RegionsEnsure","name":"regions_ensure"}},{"Action":{"action_name":"disk_create.create_volume_record","label":"CreateVolumeRecord","name":"created_volume"}},{"Action":{"action_name":"disk_create.finalize_disk_record","label":"FinalizeDiskRecord","name":"disk_runtime"}},{"Start":{"params":{"create_params":{"description":"","disk_source":{"block_size":512,"type":"blank"},"name":"disk-fd21f701a52","size":1073741824},"project_id":"1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","silo_user_id":"0b2a0ba2-c679-4886-a1b8-ae9858bb938c"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"disk-create","start_node":9} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
30842024-11-27T18:34:49.458ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create
30852024-11-27T18:34:49.463ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create
30862024-11-27T18:34:49.463ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
30872024-11-27T18:34:49.463ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
30882024-11-27T18:34:49.463ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3
30892024-11-27T18:34:49.465ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
30902024-11-27T18:34:49.465ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3
30912024-11-27T18:34:49.469ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
30922024-11-27T18:34:49.469ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3
30932024-11-27T18:34:49.472ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
30942024-11-27T18:34:49.472ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("f2af568b-8ca2-42bb-b43b-7f88d8c05693")) node_id = 0 saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3
30952024-11-27T18:34:49.475ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
30962024-11-27T18:34:49.475ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3
30972024-11-27T18:34:49.490ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
30982024-11-27T18:34:49.490ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("97450aea-f289-488a-9018-7636ae61c98d")) node_id = 1 saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3
30992024-11-27T18:34:49.493ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
31002024-11-27T18:34:49.493ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3
31012024-11-27T18:34:49.497ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = CreateDiskRecord
31022024-11-27T18:34:49.497ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = CreateDiskRecord
31032024-11-27T18:34:49.498ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = CreateDiskRecord
31042024-11-27T18:34:49.498ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = CreateDiskRecord
31052024-11-27T18:34:49.500ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = CreateDiskRecord
31062024-11-27T18:34:49.500ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = CreateDiskRecord
31072024-11-27T18:34:49.502ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = CreateDiskRecord
31082024-11-27T18:34:49.502ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = CreateDiskRecord
31092024-11-27T18:34:49.504ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = CreateDiskRecord
31102024-11-27T18:34:49.504ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = CreateDiskRecord
31112024-11-27T18:34:49.506ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = CreateDiskRecord
31122024-11-27T18:34:49.507ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = CreateDiskRecord
31132024-11-27T18:34:49.509ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = CreateDiskRecord
31142024-11-27T18:34:49.511ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba, lookup_type: ById(1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba) } result = Ok(()) saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = CreateDiskRecord
31152024-11-27T18:34:49.511ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = CreateDiskRecord
31162024-11-27T18:34:49.511ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = CreateDiskRecord
31172024-11-27T18:34:49.514ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = CreateDiskRecord
31182024-11-27T18:34:49.514ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = CreateDiskRecord
31192024-11-27T18:34:49.516ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = CreateDiskRecord
31202024-11-27T18:34:49.516ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = CreateDiskRecord
31212024-11-27T18:34:49.518ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = CreateDiskRecord
31222024-11-27T18:34:49.518ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = CreateDiskRecord
31232024-11-27T18:34:49.521ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = CreateDiskRecord
31242024-11-27T18:34:49.523ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba, lookup_type: ById(1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba) } result = Ok(()) saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = CreateDiskRecord
31252024-11-27T18:34:49.523ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = CreateDiskRecord
31262024-11-27T18:34:49.523ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = CreateDiskRecord
31272024-11-27T18:34:49.562ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
31282024-11-27T18:34:49.562ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("f2af568b-8ca2-42bb-b43b-7f88d8c05693"), "name": String("disk-fd21f701a52"), "time_created": String("2024-11-27T18:34:49.497191Z"), "time_deleted": Null, "time_modified": String("2024-11-27T18:34:49.497191Z")}, "pantry_address": Null, "project_id": String("1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2024-11-27T18:34:49.497191Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("97450aea-f289-488a-9018-7636ae61c98d")}) node_id = 2 saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3
31292024-11-27T18:34:49.569ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
31302024-11-27T18:34:49.569ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3
31312024-11-27T18:34:49.573ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = RegionsAlloc
31322024-11-27T18:34:49.573ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = RegionsAlloc
31332024-11-27T18:34:49.626ZINFOnexus (datastore): Allocated regions for volume datasets_and_regions = [(Dataset { identity: DatasetIdentity { id: f47fccf8-e5a3-428a-bae3-2c0f225051db (dataset), time_created: 2024-11-27T18:34:43.283063Z, time_modified: 2024-11-27T18:34:43.283063Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: 33ff9715-c66b-45c4-9a97-43098ad69946, ip: Some(fd00:1122:3344:101::14), port: Some(SqlU16(32345)), kind: Crucible, size_used: Some(1073741824), zone_name: None, quota: None, reservation: None, compression: None }, Region { identity: RegionIdentity { id: c729d53d-5703-4a58-95f0-ab42e08aad19, time_created: 2024-11-27T18:34:49.587244Z, time_modified: 2024-11-27T18:34:49.587244Z }, dataset_id: f47fccf8-e5a3-428a-bae3-2c0f225051db (dataset), volume_id: 97450aea-f289-488a-9018-7636ae61c98d, block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false, deleting: false }), (Dataset { identity: DatasetIdentity { id: c6a93460-0e23-4849-b6cc-0af3bc75ca67 (dataset), time_created: 2024-11-27T18:34:43.283063Z, time_modified: 2024-11-27T18:34:43.283063Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: 47e30405-53ed-469e-8f6d-991c7a3d6788, ip: Some(fd00:1122:3344:101::16), port: Some(SqlU16(32345)), kind: Crucible, size_used: Some(1073741824), zone_name: None, quota: None, reservation: None, compression: None }, Region { identity: RegionIdentity { id: a9b5fd0c-d4d7-44da-9ba3-1dfc90a1042c, time_created: 2024-11-27T18:34:49.587244Z, time_modified: 2024-11-27T18:34:49.587244Z }, dataset_id: c6a93460-0e23-4849-b6cc-0af3bc75ca67 (dataset), volume_id: 97450aea-f289-488a-9018-7636ae61c98d, block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false, deleting: false }), (Dataset { identity: DatasetIdentity { id: f107f7e3-c57d-4ff9-a94a-20a83569d772 (dataset), time_created: 2024-11-27T18:34:43.283064Z, time_modified: 2024-11-27T18:34:43.283064Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: f16fc47c-323a-43fa-b3f8-74cbe3a81dac, ip: Some(fd00:1122:3344:101::17), port: Some(SqlU16(32345)), kind: Crucible, size_used: Some(1073741824), zone_name: None, quota: None, reservation: None, compression: None }, Region { identity: RegionIdentity { id: 4a3b4378-7a47-4381-abec-4d4a4b8524cc, time_created: 2024-11-27T18:34:49.587244Z, time_modified: 2024-11-27T18:34:49.587244Z }, dataset_id: f107f7e3-c57d-4ff9-a94a-20a83569d772 (dataset), volume_id: 97450aea-f289-488a-9018-7636ae61c98d, block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false, deleting: false })] file = nexus/db-queries/src/db/datastore/region.rs:282 maybe_snapshot_id = None volume_id = 97450aea-f289-488a-9018-7636ae61c98d
31342024-11-27T18:34:49.626ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
31352024-11-27T18:34:49.626ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Array [Object {"compression": Null, "identity": Object {"id": String("f47fccf8-e5a3-428a-bae3-2c0f225051db"), "time_created": String("2024-11-27T18:34:43.283063Z"), "time_modified": String("2024-11-27T18:34:43.283063Z")}, "ip": String("fd00:1122:3344:101::14"), "kind": String("Crucible"), "pool_id": String("33ff9715-c66b-45c4-9a97-43098ad69946"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("f47fccf8-e5a3-428a-bae3-2c0f225051db"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("c729d53d-5703-4a58-95f0-ab42e08aad19"), "time_created": String("2024-11-27T18:34:49.587244Z"), "time_modified": String("2024-11-27T18:34:49.587244Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("97450aea-f289-488a-9018-7636ae61c98d")}], Array [Object {"compression": Null, "identity": Object {"id": String("c6a93460-0e23-4849-b6cc-0af3bc75ca67"), "time_created": String("2024-11-27T18:34:43.283063Z"), "time_modified": String("2024-11-27T18:34:43.283063Z")}, "ip": String("fd00:1122:3344:101::16"), "kind": String("Crucible"), "pool_id": String("47e30405-53ed-469e-8f6d-991c7a3d6788"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("c6a93460-0e23-4849-b6cc-0af3bc75ca67"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("a9b5fd0c-d4d7-44da-9ba3-1dfc90a1042c"), "time_created": String("2024-11-27T18:34:49.587244Z"), "time_modified": String("2024-11-27T18:34:49.587244Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("97450aea-f289-488a-9018-7636ae61c98d")}], Array [Object {"compression": Null, "identity": Object {"id": String("f107f7e3-c57d-4ff9-a94a-20a83569d772"), "time_created": String("2024-11-27T18:34:43.283064Z"), "time_modified": String("2024-11-27T18:34:43.283064Z")}, "ip": String("fd00:1122:3344:101::17"), "kind": String("Crucible"), "pool_id": String("f16fc47c-323a-43fa-b3f8-74cbe3a81dac"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("f107f7e3-c57d-4ff9-a94a-20a83569d772"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("4a3b4378-7a47-4381-abec-4d4a4b8524cc"), "time_created": String("2024-11-27T18:34:49.587244Z"), "time_modified": String("2024-11-27T18:34:49.587244Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("97450aea-f289-488a-9018-7636ae61c98d")}]]) node_id = 3 saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3
31362024-11-27T18:34:49.632ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
31372024-11-27T18:34:49.632ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3
31382024-11-27T18:34:49.635ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = SpaceAccount
31392024-11-27T18:34:49.635ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = SpaceAccount
31402024-11-27T18:34:49.661ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
31412024-11-27T18:34:49.661ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3
31422024-11-27T18:34:49.665ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
31432024-11-27T18:34:49.665ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3
31442024-11-27T18:34:49.667ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
31452024-11-27T18:34:49.667ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3
31462024-11-27T18:34:49.671ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
31472024-11-27T18:34:49.671ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3
31482024-11-27T18:34:49.697ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 263.853897ms dataset = f107f7e3-c57d-4ff9-a94a-20a83569d772 file = nexus/src/app/crucible.rs:231 region = 4a3b4378-7a47-4381-abec-4d4a4b8524cc saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create
31492024-11-27T18:34:49.697ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 349.169609ms dataset = c6a93460-0e23-4849-b6cc-0af3bc75ca67 file = nexus/src/app/crucible.rs:231 region = a9b5fd0c-d4d7-44da-9ba3-1dfc90a1042c saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create
31502024-11-27T18:34:49.703ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 318.876952ms dataset = f47fccf8-e5a3-428a-bae3-2c0f225051db file = nexus/src/app/crucible.rs:231 region = c729d53d-5703-4a58-95f0-ab42e08aad19 saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create
31512024-11-27T18:34:50.080ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
31522024-11-27T18:34:50.080ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"f2af568b-8ca2-42bb-b43b-7f88d8c05693\\",\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":16,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"f2af568b-8ca2-42bb-b43b-7f88d8c05693\\",\\"key\\":\\"ZIqssA8G0lsOGrVl+sRvDSg2OAgRBJ2MEuFXElzwVfk=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"[fd00:1122:3344:101::17]:19000\\",\\"[fd00:1122:3344:101::14]:19000\\",\\"[fd00:1122:3344:101::16]:19000\\"]}}]}")) node_id = 6 saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3
31532024-11-27T18:34:50.085ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
31542024-11-27T18:34:50.085ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3
31552024-11-27T18:34:50.124ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
31562024-11-27T18:34:50.125ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 7 saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3
31572024-11-27T18:34:50.128ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
31582024-11-27T18:34:50.128ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3
31592024-11-27T18:34:50.132ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = FinalizeDiskRecord
31602024-11-27T18:34:50.132ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = FinalizeDiskRecord
31612024-11-27T18:34:50.135ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = FinalizeDiskRecord
31622024-11-27T18:34:50.136ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = FinalizeDiskRecord
31632024-11-27T18:34:50.137ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = FinalizeDiskRecord
31642024-11-27T18:34:50.138ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = FinalizeDiskRecord
31652024-11-27T18:34:50.139ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = FinalizeDiskRecord
31662024-11-27T18:34:50.139ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = FinalizeDiskRecord
31672024-11-27T18:34:50.141ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = FinalizeDiskRecord
31682024-11-27T18:34:50.141ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = FinalizeDiskRecord
31692024-11-27T18:34:50.144ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = FinalizeDiskRecord
31702024-11-27T18:34:50.145ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = FinalizeDiskRecord
31712024-11-27T18:34:50.147ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = FinalizeDiskRecord
31722024-11-27T18:34:50.147ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = FinalizeDiskRecord
31732024-11-27T18:34:50.150ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = FinalizeDiskRecord
31742024-11-27T18:34:50.153ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba, lookup_type: ById(1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba) }, key: f2af568b-8ca2-42bb-b43b-7f88d8c05693, lookup_type: ById(f2af568b-8ca2-42bb-b43b-7f88d8c05693) } result = Ok(()) saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = FinalizeDiskRecord
31752024-11-27T18:34:50.153ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = FinalizeDiskRecord
31762024-11-27T18:34:50.153ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = FinalizeDiskRecord
31772024-11-27T18:34:50.156ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = FinalizeDiskRecord
31782024-11-27T18:34:50.156ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = FinalizeDiskRecord
31792024-11-27T18:34:50.158ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = FinalizeDiskRecord
31802024-11-27T18:34:50.158ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = FinalizeDiskRecord
31812024-11-27T18:34:50.161ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = FinalizeDiskRecord
31822024-11-27T18:34:50.161ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = FinalizeDiskRecord
31832024-11-27T18:34:50.163ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = FinalizeDiskRecord
31842024-11-27T18:34:50.166ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba, lookup_type: ById(1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba) }, key: f2af568b-8ca2-42bb-b43b-7f88d8c05693, lookup_type: ById(f2af568b-8ca2-42bb-b43b-7f88d8c05693) } result = Ok(()) saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = FinalizeDiskRecord
31852024-11-27T18:34:50.166ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = FinalizeDiskRecord
31862024-11-27T18:34:50.166ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_node = FinalizeDiskRecord
31872024-11-27T18:34:50.192ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
31882024-11-27T18:34:50.192ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3
31892024-11-27T18:34:50.196ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
31902024-11-27T18:34:50.196ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3
31912024-11-27T18:34:50.199ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
31922024-11-27T18:34:50.199ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3
31932024-11-27T18:34:50.203ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
31942024-11-27T18:34:50.203ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3
31952024-11-27T18:34:50.210ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
31962024-11-27T18:34:50.210ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3 saga_name = disk-create saga_result = SagaResult { saga_id: 7b69dd30-2708-4fd5-97b1-7624aa09c5a3, saga_log: SagaLog { saga_id: 7b69dd30-2708-4fd5-97b1-7624aa09c5a3, unwinding: false, events: [N009 started, N009 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N010 started, N010 succeeded], node_status: {0: Succeeded(String("f2af568b-8ca2-42bb-b43b-7f88d8c05693")), 1: Succeeded(String("97450aea-f289-488a-9018-7636ae61c98d")), 2: Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("f2af568b-8ca2-42bb-b43b-7f88d8c05693"), "name": String("disk-fd21f701a52"), "time_created": String("2024-11-27T18:34:49.497191Z"), "time_deleted": Null, "time_modified": String("2024-11-27T18:34:49.497191Z")}, "pantry_address": Null, "project_id": String("1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2024-11-27T18:34:49.497191Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("97450aea-f289-488a-9018-7636ae61c98d")}), 3: Succeeded(Array [Array [Object {"compression": Null, "identity": Object {"id": String("f47fccf8-e5a3-428a-bae3-2c0f225051db"), "time_created": String("2024-11-27T18:34:43.283063Z"), "time_modified": String("2024-11-27T18:34:43.283063Z")}, "ip": String("fd00:1122:3344:101::14"), "kind": String("Crucible"), "pool_id": String("33ff9715-c66b-45c4-9a97-43098ad69946"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("f47fccf8-e5a3-428a-bae3-2c0f225051db"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("c729d53d-5703-4a58-95f0-ab42e08aad19"), "time_created": String("2024-11-27T18:34:49.587244Z"), "time_modified": String("2024-11-27T18:34:49.587244Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("97450aea-f289-488a-9018-7636ae61c98d")}], Array [Object {"compression": Null, "identity": Object {"id": String("c6a93460-0e23-4849-b6cc-0af3bc75ca67"), "time_created": String("2024-11-27T18:34:43.283063Z"), "time_modified": String("2024-11-27T18:34:43.283063Z")}, "ip": String("fd00:1122:3344:101::16"), "kind": String("Crucible"), "pool_id": String("47e30405-53ed-469e-8f6d-991c7a3d6788"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("c6a93460-0e23-4849-b6cc-0af3bc75ca67"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("a9b5fd0c-d4d7-44da-9ba3-1dfc90a1042c"), "time_created": String("2024-11-27T18:34:49.587244Z"), "time_modified": String("2024-11-27T18:34:49.587244Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("97450aea-f289-488a-9018-7636ae61c98d")}], Array [Object {"compression": Null, "identity": Object {"id": String("f107f7e3-c57d-4ff9-a94a-20a83569d772"), "time_created": String("2024-11-27T18:34:43.283064Z"), "time_modified": String("2024-11-27T18:34:43.283064Z")}, "ip": String("fd00:1122:3344:101::17"), "kind": String("Crucible"), "pool_id": String("f16fc47c-323a-43fa-b3f8-74cbe3a81dac"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("f107f7e3-c57d-4ff9-a94a-20a83569d772"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("4a3b4378-7a47-4381-abec-4d4a4b8524cc"), "time_created": String("2024-11-27T18:34:49.587244Z"), "time_modified": String("2024-11-27T18:34:49.587244Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("97450aea-f289-488a-9018-7636ae61c98d")}]]), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(String("{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"f2af568b-8ca2-42bb-b43b-7f88d8c05693\\",\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":16,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"f2af568b-8ca2-42bb-b43b-7f88d8c05693\\",\\"key\\":\\"ZIqssA8G0lsOGrVl+sRvDSg2OAgRBJ2MEuFXElzwVfk=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"[fd00:1122:3344:101::17]:19000\\",\\"[fd00:1122:3344:101::14]:19000\\",\\"[fd00:1122:3344:101::16]:19000\\"]}}]}")), 7: Succeeded(Null), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"created_disk": Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("f2af568b-8ca2-42bb-b43b-7f88d8c05693"), "name": String("disk-fd21f701a52"), "time_created": String("2024-11-27T18:34:49.497191Z"), "time_deleted": Null, "time_modified": String("2024-11-27T18:34:49.497191Z")}, "pantry_address": Null, "project_id": String("1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2024-11-27T18:34:49.497191Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("97450aea-f289-488a-9018-7636ae61c98d")}, "created_volume": Null, "datasets_and_regions": Array [Array [Object {"compression": Null, "identity": Object {"id": String("f47fccf8-e5a3-428a-bae3-2c0f225051db"), "time_created": String("2024-11-27T18:34:43.283063Z"), "time_modified": String("2024-11-27T18:34:43.283063Z")}, "ip": String("fd00:1122:3344:101::14"), "kind": String("Crucible"), "pool_id": String("33ff9715-c66b-45c4-9a97-43098ad69946"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("f47fccf8-e5a3-428a-bae3-2c0f225051db"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("c729d53d-5703-4a58-95f0-ab42e08aad19"), "time_created": String("2024-11-27T18:34:49.587244Z"), "time_modified": String("2024-11-27T18:34:49.587244Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("97450aea-f289-488a-9018-7636ae61c98d")}], Array [Object {"compression": Null, "identity": Object {"id": String("c6a93460-0e23-4849-b6cc-0af3bc75ca67"), "time_created": String("2024-11-27T18:34:43.283063Z"), "time_modified": String("2024-11-27T18:34:43.283063Z")}, "ip": String("fd00:1122:3344:101::16"), "kind": String("Crucible"), "pool_id": String("47e30405-53ed-469e-8f6d-991c7a3d6788"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("c6a93460-0e23-4849-b6cc-0af3bc75ca67"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("a9b5fd0c-d4d7-44da-9ba3-1dfc90a1042c"), "time_created": String("2024-11-27T18:34:49.587244Z"), "time_modified": String("2024-11-27T18:34:49.587244Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("97450aea-f289-488a-9018-7636ae61c98d")}], Array [Object {"compression": Null, "identity": Object {"id": String("f107f7e3-c57d-4ff9-a94a-20a83569d772"), "time_created": String("2024-11-27T18:34:43.283064Z"), "time_modified": String("2024-11-27T18:34:43.283064Z")}, "ip": String("fd00:1122:3344:101::17"), "kind": String("Crucible"), "pool_id": String("f16fc47c-323a-43fa-b3f8-74cbe3a81dac"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("f107f7e3-c57d-4ff9-a94a-20a83569d772"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("4a3b4378-7a47-4381-abec-4d4a4b8524cc"), "time_created": String("2024-11-27T18:34:49.587244Z"), "time_modified": String("2024-11-27T18:34:49.587244Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("97450aea-f289-488a-9018-7636ae61c98d")}]], "disk_id": String("f2af568b-8ca2-42bb-b43b-7f88d8c05693"), "disk_runtime": Null, "no_result": Null, "regions_ensure": String("{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"f2af568b-8ca2-42bb-b43b-7f88d8c05693\\",\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":16,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"f2af568b-8ca2-42bb-b43b-7f88d8c05693\\",\\"key\\":\\"ZIqssA8G0lsOGrVl+sRvDSg2OAgRBJ2MEuFXElzwVfk=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"[fd00:1122:3344:101::17]:19000\\",\\"[fd00:1122:3344:101::14]:19000\\",\\"[fd00:1122:3344:101::16]:19000\\"]}}]}"), "regions_ensure_undo": Null, "volume_id": String("97450aea-f289-488a-9018-7636ae61c98d")} }) }
31972024-11-27T18:34:50.210ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 797844 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 060a609c-b6d1-4a85-ae15-a008edf495f1 response_code = 201 uri = /v1/disks?project=proj-752edbda008
31982024-11-27T18:34:50.214ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31992024-11-27T18:34:50.214ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32002024-11-27T18:34:50.216ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32012024-11-27T18:34:50.216ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32022024-11-27T18:34:50.218ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32032024-11-27T18:34:50.219ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "e736b427937bfa233f37989e8bdecb952a09e936", lookup_type: ByCompositeId("token = \\"e736b427937bfa233f37989e8bdecb952a09e936\\"") } result = Ok(())
32042024-11-27T18:34:50.219ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32052024-11-27T18:34:50.219ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32062024-11-27T18:34:50.220ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32072024-11-27T18:34:50.221ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32082024-11-27T18:34:50.222ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32092024-11-27T18:34:50.223ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32102024-11-27T18:34:50.224ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32112024-11-27T18:34:50.224ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32122024-11-27T18:34:50.226ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32132024-11-27T18:34:50.227ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, lookup_type: ById(0b2a0ba2-c679-4886-a1b8-ae9858bb938c) } result = Ok(())
32142024-11-27T18:34:50.227ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32152024-11-27T18:34:50.227ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32162024-11-27T18:34:50.229ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32172024-11-27T18:34:50.230ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "e736b427937bfa233f37989e8bdecb952a09e936", lookup_type: ByCompositeId("e736b427937bfa233f37989e8bdecb952a09e936") } result = Ok(())
32182024-11-27T18:34:50.230ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32192024-11-27T18:34:50.230ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32202024-11-27T18:34:50.233ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32212024-11-27T18:34:50.233ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32222024-11-27T18:34:50.235ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32232024-11-27T18:34:50.235ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32242024-11-27T18:34:50.237ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32252024-11-27T18:34:50.237ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32262024-11-27T18:34:50.238ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32272024-11-27T18:34:50.238ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32282024-11-27T18:34:50.240ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32292024-11-27T18:34:50.241ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, lookup_type: ById(0b2a0ba2-c679-4886-a1b8-ae9858bb938c) } result = Ok(())
32302024-11-27T18:34:50.241ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32312024-11-27T18:34:50.241ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32322024-11-27T18:34:50.242ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32332024-11-27T18:34:50.242ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32342024-11-27T18:34:50.244ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32352024-11-27T18:34:50.244ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32362024-11-27T18:34:50.246ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32372024-11-27T18:34:50.247ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) } result = Ok(())
32382024-11-27T18:34:50.247ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 91d297bb-6538-4e5a-b550-5538347eb622 roles = RoleSet { roles: {} } uri = /v1/disks/disk-fd21f701a52?project=proj-752edbda008
32392024-11-27T18:34:50.247ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 91d297bb-6538-4e5a-b550-5538347eb622 resource = Database result = Ok(()) uri = /v1/disks/disk-fd21f701a52?project=proj-752edbda008
32402024-11-27T18:34:50.248ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 91d297bb-6538-4e5a-b550-5538347eb622 roles = RoleSet { roles: {} } uri = /v1/disks/disk-fd21f701a52?project=proj-752edbda008
32412024-11-27T18:34:50.249ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 91d297bb-6538-4e5a-b550-5538347eb622 resource = Database result = Ok(()) uri = /v1/disks/disk-fd21f701a52?project=proj-752edbda008
32422024-11-27T18:34:50.250ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 91d297bb-6538-4e5a-b550-5538347eb622 roles = RoleSet { roles: {} } uri = /v1/disks/disk-fd21f701a52?project=proj-752edbda008
32432024-11-27T18:34:50.251ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 91d297bb-6538-4e5a-b550-5538347eb622 resource = Database result = Ok(()) uri = /v1/disks/disk-fd21f701a52?project=proj-752edbda008
32442024-11-27T18:34:50.253ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 91d297bb-6538-4e5a-b550-5538347eb622 roles = RoleSet { roles: {} } uri = /v1/disks/disk-fd21f701a52?project=proj-752edbda008
32452024-11-27T18:34:50.253ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 91d297bb-6538-4e5a-b550-5538347eb622 resource = Database result = Ok(()) uri = /v1/disks/disk-fd21f701a52?project=proj-752edbda008
32462024-11-27T18:34:50.256ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 91d297bb-6538-4e5a-b550-5538347eb622 roles = RoleSet { roles: {} } uri = /v1/disks/disk-fd21f701a52?project=proj-752edbda008
32472024-11-27T18:34:50.256ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 91d297bb-6538-4e5a-b550-5538347eb622 resource = Database result = Ok(()) uri = /v1/disks/disk-fd21f701a52?project=proj-752edbda008
32482024-11-27T18:34:50.259ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 91d297bb-6538-4e5a-b550-5538347eb622 roles = RoleSet { roles: {} } uri = /v1/disks/disk-fd21f701a52?project=proj-752edbda008
32492024-11-27T18:34:50.259ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 91d297bb-6538-4e5a-b550-5538347eb622 resource = Database result = Ok(()) uri = /v1/disks/disk-fd21f701a52?project=proj-752edbda008
32502024-11-27T18:34:50.261ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 91d297bb-6538-4e5a-b550-5538347eb622 roles = RoleSet { roles: {} } uri = /v1/disks/disk-fd21f701a52?project=proj-752edbda008
32512024-11-27T18:34:50.261ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 91d297bb-6538-4e5a-b550-5538347eb622 resource = Database result = Ok(()) uri = /v1/disks/disk-fd21f701a52?project=proj-752edbda008
32522024-11-27T18:34:50.264ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 91d297bb-6538-4e5a-b550-5538347eb622 roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } uri = /v1/disks/disk-fd21f701a52?project=proj-752edbda008
32532024-11-27T18:34:50.267ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 91d297bb-6538-4e5a-b550-5538347eb622 resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba, lookup_type: ByName("proj-752edbda008") }, key: f2af568b-8ca2-42bb-b43b-7f88d8c05693, lookup_type: ByName("disk-fd21f701a52") } result = Ok(()) uri = /v1/disks/disk-fd21f701a52?project=proj-752edbda008
32542024-11-27T18:34:50.267ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 91d297bb-6538-4e5a-b550-5538347eb622 roles = RoleSet { roles: {} } uri = /v1/disks/disk-fd21f701a52?project=proj-752edbda008
32552024-11-27T18:34:50.267ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 91d297bb-6538-4e5a-b550-5538347eb622 resource = Database result = Ok(()) uri = /v1/disks/disk-fd21f701a52?project=proj-752edbda008
32562024-11-27T18:34:50.269ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 91d297bb-6538-4e5a-b550-5538347eb622 roles = RoleSet { roles: {} } uri = /v1/disks/disk-fd21f701a52?project=proj-752edbda008
32572024-11-27T18:34:50.269ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 91d297bb-6538-4e5a-b550-5538347eb622 resource = Database result = Ok(()) uri = /v1/disks/disk-fd21f701a52?project=proj-752edbda008
32582024-11-27T18:34:50.271ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 91d297bb-6538-4e5a-b550-5538347eb622 roles = RoleSet { roles: {} } uri = /v1/disks/disk-fd21f701a52?project=proj-752edbda008
32592024-11-27T18:34:50.271ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 91d297bb-6538-4e5a-b550-5538347eb622 resource = Database result = Ok(()) uri = /v1/disks/disk-fd21f701a52?project=proj-752edbda008
32602024-11-27T18:34:50.273ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 91d297bb-6538-4e5a-b550-5538347eb622 roles = RoleSet { roles: {} } uri = /v1/disks/disk-fd21f701a52?project=proj-752edbda008
32612024-11-27T18:34:50.273ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 91d297bb-6538-4e5a-b550-5538347eb622 resource = Database result = Ok(()) uri = /v1/disks/disk-fd21f701a52?project=proj-752edbda008
32622024-11-27T18:34:50.275ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 91d297bb-6538-4e5a-b550-5538347eb622 roles = RoleSet { roles: {} } uri = /v1/disks/disk-fd21f701a52?project=proj-752edbda008
32632024-11-27T18:34:50.276ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 91d297bb-6538-4e5a-b550-5538347eb622 resource = Database result = Ok(()) uri = /v1/disks/disk-fd21f701a52?project=proj-752edbda008
32642024-11-27T18:34:50.278ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 91d297bb-6538-4e5a-b550-5538347eb622 roles = RoleSet { roles: {} } uri = /v1/disks/disk-fd21f701a52?project=proj-752edbda008
32652024-11-27T18:34:50.278ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 91d297bb-6538-4e5a-b550-5538347eb622 resource = Database result = Ok(()) uri = /v1/disks/disk-fd21f701a52?project=proj-752edbda008
32662024-11-27T18:34:50.280ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 91d297bb-6538-4e5a-b550-5538347eb622 roles = RoleSet { roles: {} } uri = /v1/disks/disk-fd21f701a52?project=proj-752edbda008
32672024-11-27T18:34:50.281ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 91d297bb-6538-4e5a-b550-5538347eb622 resource = Database result = Ok(()) uri = /v1/disks/disk-fd21f701a52?project=proj-752edbda008
32682024-11-27T18:34:50.283ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 91d297bb-6538-4e5a-b550-5538347eb622 roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } uri = /v1/disks/disk-fd21f701a52?project=proj-752edbda008
32692024-11-27T18:34:50.287ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 91d297bb-6538-4e5a-b550-5538347eb622 resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba, lookup_type: ById(1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba) }, key: f2af568b-8ca2-42bb-b43b-7f88d8c05693, lookup_type: ById(f2af568b-8ca2-42bb-b43b-7f88d8c05693) } result = Ok(()) uri = /v1/disks/disk-fd21f701a52?project=proj-752edbda008
32702024-11-27T18:34:50.287ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2 saga_name = disk-delete
32712024-11-27T18:34:50.287ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,5,null],[4,6,null],[6,7,null],[5,7,null],[7,8,null],[8,9,null],[9,10,null],[10,11,null],[3,4,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"disk_delete.delete_disk_record","label":"DeleteDiskRecord","name":"deleted_disk"}},{"Action":{"action_name":"disk_delete.space_account","label":"SpaceAccount","name":"no_result1"}},{"Constant":{"name":"params_for_volume_delete_subsaga","value":{"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","silo_user_id":"0b2a0ba2-c679-4886-a1b8-ae9858bb938c"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}},"volume_id":"97450aea-f289-488a-9018-7636ae61c98d"}}},{"SubsagaStart":{"params_node_name":"params_for_volume_delete_subsaga","saga_name":"volume-delete"}},{"Action":{"action_name":"volume_delete.decrease_crucible_resource_count","label":"DecreaseCrucibleResourceCount","name":"crucible_resources_to_delete"}},{"Action":{"action_name":"volume_delete.delete_crucible_regions","label":"DeleteCrucibleRegions","name":"no_result_1"}},{"Action":{"action_name":"volume_delete.delete_crucible_running_snapshots","label":"DeleteCrucibleRunningSnapshots","name":"no_result_2"}},{"Action":{"action_name":"volume_delete.delete_crucible_snapshots","label":"DeleteCrucibleSnapshots","name":"no_result_3"}},{"Action":{"action_name":"volume_delete.delete_crucible_snapshot_records","label":"DeleteCrucibleSnapshotRecords","name":"no_result_4"}},{"Action":{"action_name":"volume_delete.find_freed_crucible_regions","label":"FindFreedCrucibleRegions","name":"freed_crucible_regions"}},{"Action":{"action_name":"volume_delete.delete_freed_crucible_regions","label":"DeleteFreedCrucibleRegions","name":"no_result_5"}},{"Action":{"action_name":"volume_delete.hard_delete_volume_record","label":"HardDeleteVolumeRecord","name":"volume_hard_deleted"}},{"SubsagaEnd":{"name":"volume_delete_subsaga_no_result"}},{"Start":{"params":{"disk_id":"f2af568b-8ca2-42bb-b43b-7f88d8c05693","project_id":"1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","silo_user_id":"0b2a0ba2-c679-4886-a1b8-ae9858bb938c"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}},"volume_id":"97450aea-f289-488a-9018-7636ae61c98d"}}},"End"]},"saga_name":"disk-delete","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2 saga_name = disk-delete sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
32722024-11-27T18:34:50.287ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2 saga_name = disk-delete
32732024-11-27T18:34:50.290ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2 saga_name = disk-delete
32742024-11-27T18:34:50.290ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2 saga_name = disk-delete sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
32752024-11-27T18:34:50.290ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
32762024-11-27T18:34:50.290ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2
32772024-11-27T18:34:50.294ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
32782024-11-27T18:34:50.294ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2
32792024-11-27T18:34:50.297ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
32802024-11-27T18:34:50.297ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2
32812024-11-27T18:34:50.307ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
32822024-11-27T18:34:50.307ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("f2af568b-8ca2-42bb-b43b-7f88d8c05693"), "name": String("disk-fd21f701a52"), "time_created": String("2024-11-27T18:34:49.497191Z"), "time_deleted": Null, "time_modified": String("2024-11-27T18:34:49.497191Z")}, "pantry_address": Null, "project_id": String("1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-11-27T18:34:50.153440Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("97450aea-f289-488a-9018-7636ae61c98d")}) node_id = 0 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2
32832024-11-27T18:34:50.310ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
32842024-11-27T18:34:50.310ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2
32852024-11-27T18:34:50.313ZDEBGnexus (SagaExecutor): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true roles = RoleSet { roles: {} } saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2 saga_name = disk-delete saga_node = SpaceAccount
32862024-11-27T18:34:50.314ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true resource = Database result = Ok(()) saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2 saga_name = disk-delete saga_node = SpaceAccount
32872024-11-27T18:34:50.335ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
32882024-11-27T18:34:50.335ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 1 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2
32892024-11-27T18:34:50.338ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
32902024-11-27T18:34:50.338ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2
32912024-11-27T18:34:50.341ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
32922024-11-27T18:34:50.341ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba"), "silo_user_id": String("0b2a0ba2-c679-4886-a1b8-ae9858bb938c")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("97450aea-f289-488a-9018-7636ae61c98d")}) node_id = 2 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2
32932024-11-27T18:34:50.344ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
32942024-11-27T18:34:50.344ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2
32952024-11-27T18:34:50.347ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
32962024-11-27T18:34:50.347ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2
32972024-11-27T18:34:50.350ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
32982024-11-27T18:34:50.350ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2
32992024-11-27T18:34:50.372ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
33002024-11-27T18:34:50.372ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("4a3b4378-7a47-4381-abec-4d4a4b8524cc"), String("c729d53d-5703-4a58-95f0-ab42e08aad19"), String("a9b5fd0c-d4d7-44da-9ba3-1dfc90a1042c")]}}) node_id = 4 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2
33012024-11-27T18:34:50.375ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
33022024-11-27T18:34:50.375ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2
33032024-11-27T18:34:50.378ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
33042024-11-27T18:34:50.378ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2
33052024-11-27T18:34:50.382ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
33062024-11-27T18:34:50.382ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2
33072024-11-27T18:34:50.417ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 109.257957ms file = nexus/src/app/crucible.rs:828 region_id = a9b5fd0c-d4d7-44da-9ba3-1dfc90a1042c saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2 saga_name = disk-delete
33082024-11-27T18:34:50.417ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 107.706476ms file = nexus/src/app/crucible.rs:828 region_id = 4a3b4378-7a47-4381-abec-4d4a4b8524cc saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2 saga_name = disk-delete
33092024-11-27T18:34:50.419ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 145.031042ms file = nexus/src/app/crucible.rs:828 region_id = c729d53d-5703-4a58-95f0-ab42e08aad19 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2 saga_name = disk-delete
33102024-11-27T18:34:50.531ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:813 region_id = 4a3b4378-7a47-4381-abec-4d4a4b8524cc saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2 saga_name = disk-delete
33112024-11-27T18:34:50.531ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:813 region_id = a9b5fd0c-d4d7-44da-9ba3-1dfc90a1042c saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2 saga_name = disk-delete
33122024-11-27T18:34:50.569ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:813 region_id = c729d53d-5703-4a58-95f0-ab42e08aad19 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2 saga_name = disk-delete
33132024-11-27T18:34:50.582ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
33142024-11-27T18:34:50.582ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2
33152024-11-27T18:34:50.586ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
33162024-11-27T18:34:50.586ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2
33172024-11-27T18:34:50.590ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
33182024-11-27T18:34:50.590ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 7 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2
33192024-11-27T18:34:50.593ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
33202024-11-27T18:34:50.593ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2
33212024-11-27T18:34:50.596ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
33222024-11-27T18:34:50.596ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2
33232024-11-27T18:34:50.599ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
33242024-11-27T18:34:50.599ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2
33252024-11-27T18:34:50.607ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
33262024-11-27T18:34:50.607ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array []) node_id = 9 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2
33272024-11-27T18:34:50.609ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
33282024-11-27T18:34:50.609ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2
33292024-11-27T18:34:50.612ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
33302024-11-27T18:34:50.612ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2
33312024-11-27T18:34:50.615ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
33322024-11-27T18:34:50.615ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2
33332024-11-27T18:34:50.620ZINFOnexus (SagaExecutor): allocated regions for 97450aea-f289-488a-9018-7636ae61c98d is empty, calling volume_hard_delete file = nexus/src/app/sagas/volume_delete.rs:531 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2 saga_name = disk-delete
33342024-11-27T18:34:50.622ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
33352024-11-27T18:34:50.622ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Bool(true)) node_id = 11 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2
33362024-11-27T18:34:50.625ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
33372024-11-27T18:34:50.625ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2
33382024-11-27T18:34:50.628ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
33392024-11-27T18:34:50.628ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Bool(true)) node_id = 12 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2
33402024-11-27T18:34:50.630ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
33412024-11-27T18:34:50.630ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2
33422024-11-27T18:34:50.633ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
33432024-11-27T18:34:50.633ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2
33442024-11-27T18:34:50.635ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2 sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
33452024-11-27T18:34:50.635ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2
33462024-11-27T18:34:50.671ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2 saga_name = disk-delete sec_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
33472024-11-27T18:34:50.671ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2 saga_name = disk-delete saga_result = SagaResult { saga_id: e610aa32-f1a2-472d-ac42-268cbf1b98b2, saga_log: SagaLog { saga_id: e610aa32-f1a2-472d-ac42-268cbf1b98b2, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N006 started, N006 succeeded, N005 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("f2af568b-8ca2-42bb-b43b-7f88d8c05693"), "name": String("disk-fd21f701a52"), "time_created": String("2024-11-27T18:34:49.497191Z"), "time_deleted": Null, "time_modified": String("2024-11-27T18:34:49.497191Z")}, "pantry_address": Null, "project_id": String("1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-11-27T18:34:50.153440Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("97450aea-f289-488a-9018-7636ae61c98d")}), 1: Succeeded(Null), 2: Succeeded(Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba"), "silo_user_id": String("0b2a0ba2-c679-4886-a1b8-ae9858bb938c")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("97450aea-f289-488a-9018-7636ae61c98d")}), 3: Succeeded(Null), 4: Succeeded(Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("4a3b4378-7a47-4381-abec-4d4a4b8524cc"), String("c729d53d-5703-4a58-95f0-ab42e08aad19"), String("a9b5fd0c-d4d7-44da-9ba3-1dfc90a1042c")]}}), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Null), 8: Succeeded(Null), 9: Succeeded(Array []), 10: Succeeded(Null), 11: Succeeded(Bool(true)), 12: Succeeded(Bool(true)), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Bool(true), node_outputs: {"crucible_resources_to_delete": Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("4a3b4378-7a47-4381-abec-4d4a4b8524cc"), String("c729d53d-5703-4a58-95f0-ab42e08aad19"), String("a9b5fd0c-d4d7-44da-9ba3-1dfc90a1042c")]}}, "deleted_disk": Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("f2af568b-8ca2-42bb-b43b-7f88d8c05693"), "name": String("disk-fd21f701a52"), "time_created": String("2024-11-27T18:34:49.497191Z"), "time_deleted": Null, "time_modified": String("2024-11-27T18:34:49.497191Z")}, "pantry_address": Null, "project_id": String("1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-11-27T18:34:50.153440Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("97450aea-f289-488a-9018-7636ae61c98d")}, "freed_crucible_regions": Array [], "no_result1": Null, "no_result_1": Null, "no_result_2": Null, "no_result_3": Null, "no_result_4": Null, "no_result_5": Null, "params_for_volume_delete_subsaga": Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("40016410-ac98-42a3-b0ca-e7ce46b4e8ba"), "silo_user_id": String("0b2a0ba2-c679-4886-a1b8-ae9858bb938c")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("97450aea-f289-488a-9018-7636ae61c98d")}, "volume_delete_subsaga_no_result": Bool(true), "volume_hard_deleted": Bool(true)} }) }
33482024-11-27T18:34:50.671ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 457241 local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 91d297bb-6538-4e5a-b550-5538347eb622 response_code = 204 uri = /v1/disks/disk-fd21f701a52?project=proj-752edbda008
33492024-11-27T18:34:50.674ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33502024-11-27T18:34:50.675ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33512024-11-27T18:34:50.676ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33522024-11-27T18:34:50.678ZDEBGnexus (ExternalAuthn): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = DeviceAuthRequestList result = Ok(())
33532024-11-27T18:34:50.678ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33542024-11-27T18:34:50.678ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33552024-11-27T18:34:50.689ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 16552 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = a0302631-213d-481b-b4cd-f83b555bdc04 response_code = 200 uri = /device/auth
33562024-11-27T18:34:50.690ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33572024-11-27T18:34:50.690ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33582024-11-27T18:34:50.691ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33592024-11-27T18:34:50.692ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33602024-11-27T18:34:50.693ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33612024-11-27T18:34:50.694ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "e736b427937bfa233f37989e8bdecb952a09e936", lookup_type: ByCompositeId("token = \\"e736b427937bfa233f37989e8bdecb952a09e936\\"") } result = Ok(())
33622024-11-27T18:34:50.694ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33632024-11-27T18:34:50.694ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33642024-11-27T18:34:50.695ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33652024-11-27T18:34:50.696ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33662024-11-27T18:34:50.697ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33672024-11-27T18:34:50.697ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33682024-11-27T18:34:50.699ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33692024-11-27T18:34:50.699ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33702024-11-27T18:34:50.700ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33712024-11-27T18:34:50.701ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, lookup_type: ById(0b2a0ba2-c679-4886-a1b8-ae9858bb938c) } result = Ok(())
33722024-11-27T18:34:50.701ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33732024-11-27T18:34:50.702ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33742024-11-27T18:34:50.702ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33752024-11-27T18:34:50.704ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "e736b427937bfa233f37989e8bdecb952a09e936", lookup_type: ByCompositeId("e736b427937bfa233f37989e8bdecb952a09e936") } result = Ok(())
33762024-11-27T18:34:50.704ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33772024-11-27T18:34:50.704ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33782024-11-27T18:34:50.707ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33792024-11-27T18:34:50.707ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33802024-11-27T18:34:50.709ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33812024-11-27T18:34:50.709ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33822024-11-27T18:34:50.710ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33832024-11-27T18:34:50.710ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33842024-11-27T18:34:50.711ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33852024-11-27T18:34:50.711ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33862024-11-27T18:34:50.713ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33872024-11-27T18:34:50.714ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, lookup_type: ById(0b2a0ba2-c679-4886-a1b8-ae9858bb938c) } result = Ok(())
33882024-11-27T18:34:50.714ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33892024-11-27T18:34:50.714ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33902024-11-27T18:34:50.715ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33912024-11-27T18:34:50.716ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33922024-11-27T18:34:50.717ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33932024-11-27T18:34:50.717ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33942024-11-27T18:34:50.718ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33952024-11-27T18:34:50.719ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) } result = Ok(())
33962024-11-27T18:34:50.719ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = e8aab59e-9d79-4438-8099-1d90eb5a2d01 roles = RoleSet { roles: {} } uri = /device/confirm
33972024-11-27T18:34:50.719ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = e8aab59e-9d79-4438-8099-1d90eb5a2d01 resource = Database result = Ok(()) uri = /device/confirm
33982024-11-27T18:34:50.721ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = e8aab59e-9d79-4438-8099-1d90eb5a2d01 roles = RoleSet { roles: {} } uri = /device/confirm
33992024-11-27T18:34:50.721ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = e8aab59e-9d79-4438-8099-1d90eb5a2d01 resource = Database result = Ok(()) uri = /device/confirm
34002024-11-27T18:34:50.723ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = e8aab59e-9d79-4438-8099-1d90eb5a2d01 roles = RoleSet { roles: {} } uri = /device/confirm
34012024-11-27T18:34:50.723ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = e8aab59e-9d79-4438-8099-1d90eb5a2d01 resource = Database result = Ok(()) uri = /device/confirm
34022024-11-27T18:34:50.725ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = e8aab59e-9d79-4438-8099-1d90eb5a2d01 roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } uri = /device/confirm
34032024-11-27T18:34:50.726ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = e8aab59e-9d79-4438-8099-1d90eb5a2d01 resource = DeviceAuthRequest { parent: Fleet, key: "PSTC-LRVZ", lookup_type: ByCompositeId("user_code = \\"PSTC-LRVZ\\"") } result = Ok(()) uri = /device/confirm
34042024-11-27T18:34:50.726ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = e8aab59e-9d79-4438-8099-1d90eb5a2d01 roles = RoleSet { roles: {} } uri = /device/confirm
34052024-11-27T18:34:50.726ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = e8aab59e-9d79-4438-8099-1d90eb5a2d01 resource = Database result = Ok(()) uri = /device/confirm
34062024-11-27T18:34:50.727ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = e8aab59e-9d79-4438-8099-1d90eb5a2d01 roles = RoleSet { roles: {} } uri = /device/confirm
34072024-11-27T18:34:50.727ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = e8aab59e-9d79-4438-8099-1d90eb5a2d01 resource = Database result = Ok(()) uri = /device/confirm
34082024-11-27T18:34:50.728ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = e8aab59e-9d79-4438-8099-1d90eb5a2d01 roles = RoleSet { roles: {} } uri = /device/confirm
34092024-11-27T18:34:50.729ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = e8aab59e-9d79-4438-8099-1d90eb5a2d01 resource = Database result = Ok(()) uri = /device/confirm
34102024-11-27T18:34:50.731ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = e8aab59e-9d79-4438-8099-1d90eb5a2d01 roles = RoleSet { roles: {} } uri = /device/confirm
34112024-11-27T18:34:50.731ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = e8aab59e-9d79-4438-8099-1d90eb5a2d01 resource = Database result = Ok(()) uri = /device/confirm
34122024-11-27T18:34:50.733ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = e8aab59e-9d79-4438-8099-1d90eb5a2d01 roles = RoleSet { roles: {} } uri = /device/confirm
34132024-11-27T18:34:50.733ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = e8aab59e-9d79-4438-8099-1d90eb5a2d01 resource = Database result = Ok(()) uri = /device/confirm
34142024-11-27T18:34:50.735ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = e8aab59e-9d79-4438-8099-1d90eb5a2d01 roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } uri = /device/confirm
34152024-11-27T18:34:50.736ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = e8aab59e-9d79-4438-8099-1d90eb5a2d01 resource = SiloUser { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, lookup_type: ById(0b2a0ba2-c679-4886-a1b8-ae9858bb938c) } result = Ok(()) uri = /device/confirm
34162024-11-27T18:34:50.736ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = e8aab59e-9d79-4438-8099-1d90eb5a2d01 roles = RoleSet { roles: {} } uri = /device/confirm
34172024-11-27T18:34:50.736ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = e8aab59e-9d79-4438-8099-1d90eb5a2d01 resource = Database result = Ok(()) uri = /device/confirm
34182024-11-27T18:34:50.739ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = e8aab59e-9d79-4438-8099-1d90eb5a2d01 roles = RoleSet { roles: {} } uri = /device/confirm
34192024-11-27T18:34:50.739ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = e8aab59e-9d79-4438-8099-1d90eb5a2d01 resource = Database result = Ok(()) uri = /device/confirm
34202024-11-27T18:34:50.741ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = e8aab59e-9d79-4438-8099-1d90eb5a2d01 roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } uri = /device/confirm
34212024-11-27T18:34:50.742ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = e8aab59e-9d79-4438-8099-1d90eb5a2d01 resource = DeviceAuthRequest { parent: Fleet, key: "PSTC-LRVZ", lookup_type: ByCompositeId("user_code = \\"PSTC-LRVZ\\"") } result = Ok(()) uri = /device/confirm
34222024-11-27T18:34:50.742ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = e8aab59e-9d79-4438-8099-1d90eb5a2d01 roles = RoleSet { roles: {} } uri = /device/confirm
34232024-11-27T18:34:50.742ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = e8aab59e-9d79-4438-8099-1d90eb5a2d01 resource = Database result = Ok(()) uri = /device/confirm
34242024-11-27T18:34:50.744ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = e8aab59e-9d79-4438-8099-1d90eb5a2d01 roles = RoleSet { roles: {} } uri = /device/confirm
34252024-11-27T18:34:50.745ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = e8aab59e-9d79-4438-8099-1d90eb5a2d01 resource = Database result = Ok(()) uri = /device/confirm
34262024-11-27T18:34:50.746ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = e8aab59e-9d79-4438-8099-1d90eb5a2d01 roles = RoleSet { roles: {} } uri = /device/confirm
34272024-11-27T18:34:50.746ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = e8aab59e-9d79-4438-8099-1d90eb5a2d01 resource = Database result = Ok(()) uri = /device/confirm
34282024-11-27T18:34:50.748ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = e8aab59e-9d79-4438-8099-1d90eb5a2d01 roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } uri = /device/confirm
34292024-11-27T18:34:50.749ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = e8aab59e-9d79-4438-8099-1d90eb5a2d01 resource = SiloUser { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, lookup_type: ById(0b2a0ba2-c679-4886-a1b8-ae9858bb938c) } result = Ok(()) uri = /device/confirm
34302024-11-27T18:34:50.749ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = e8aab59e-9d79-4438-8099-1d90eb5a2d01 roles = RoleSet { roles: {} } uri = /device/confirm
34312024-11-27T18:34:50.750ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = e8aab59e-9d79-4438-8099-1d90eb5a2d01 resource = Database result = Ok(()) uri = /device/confirm
34322024-11-27T18:34:50.759ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69492 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = e8aab59e-9d79-4438-8099-1d90eb5a2d01 response_code = 204 uri = /device/confirm
34332024-11-27T18:34:50.762ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34342024-11-27T18:34:50.762ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34352024-11-27T18:34:50.771ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10825 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:40247 req_id = 61840945-3e05-4fc7-84fc-b8ec59fc790c response_code = 200 uri = /device/token
34362024-11-27T18:34:50.778ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34372024-11-27T18:34:50.778ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34382024-11-27T18:34:50.779ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34392024-11-27T18:34:50.780ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34402024-11-27T18:34:50.781ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34412024-11-27T18:34:50.782ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "e736b427937bfa233f37989e8bdecb952a09e936", lookup_type: ByCompositeId("token = \\"e736b427937bfa233f37989e8bdecb952a09e936\\"") } result = Ok(())
34422024-11-27T18:34:50.782ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34432024-11-27T18:34:50.782ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34442024-11-27T18:34:50.783ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34452024-11-27T18:34:50.783ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34462024-11-27T18:34:50.785ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34472024-11-27T18:34:50.785ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34482024-11-27T18:34:50.786ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34492024-11-27T18:34:50.786ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34502024-11-27T18:34:50.787ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34512024-11-27T18:34:50.789ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, lookup_type: ById(0b2a0ba2-c679-4886-a1b8-ae9858bb938c) } result = Ok(())
34522024-11-27T18:34:50.789ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34532024-11-27T18:34:50.789ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34542024-11-27T18:34:50.790ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34552024-11-27T18:34:50.791ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "e736b427937bfa233f37989e8bdecb952a09e936", lookup_type: ByCompositeId("e736b427937bfa233f37989e8bdecb952a09e936") } result = Ok(())
34562024-11-27T18:34:50.791ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34572024-11-27T18:34:50.791ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34582024-11-27T18:34:50.794ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34592024-11-27T18:34:50.794ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34602024-11-27T18:34:50.795ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34612024-11-27T18:34:50.795ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34622024-11-27T18:34:50.797ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34632024-11-27T18:34:50.797ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34642024-11-27T18:34:50.798ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34652024-11-27T18:34:50.798ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34662024-11-27T18:34:50.799ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34672024-11-27T18:34:50.800ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, lookup_type: ById(0b2a0ba2-c679-4886-a1b8-ae9858bb938c) } result = Ok(())
34682024-11-27T18:34:50.800ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34692024-11-27T18:34:50.800ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34702024-11-27T18:34:50.802ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34712024-11-27T18:34:50.802ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34722024-11-27T18:34:50.803ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34732024-11-27T18:34:50.803ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34742024-11-27T18:34:50.804ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34752024-11-27T18:34:50.805ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) } result = Ok(())
34762024-11-27T18:34:50.805ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 620133bb-27bf-438d-9c59-fa59b3362b91 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-752edbda008&vpc=default
34772024-11-27T18:34:50.806ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 620133bb-27bf-438d-9c59-fa59b3362b91 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-752edbda008&vpc=default
34782024-11-27T18:34:50.807ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 620133bb-27bf-438d-9c59-fa59b3362b91 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-752edbda008&vpc=default
34792024-11-27T18:34:50.807ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 620133bb-27bf-438d-9c59-fa59b3362b91 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-752edbda008&vpc=default
34802024-11-27T18:34:50.808ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 620133bb-27bf-438d-9c59-fa59b3362b91 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-752edbda008&vpc=default
34812024-11-27T18:34:50.809ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 620133bb-27bf-438d-9c59-fa59b3362b91 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-752edbda008&vpc=default
34822024-11-27T18:34:50.810ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 620133bb-27bf-438d-9c59-fa59b3362b91 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-752edbda008&vpc=default
34832024-11-27T18:34:50.810ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 620133bb-27bf-438d-9c59-fa59b3362b91 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-752edbda008&vpc=default
34842024-11-27T18:34:50.812ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 620133bb-27bf-438d-9c59-fa59b3362b91 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-752edbda008&vpc=default
34852024-11-27T18:34:50.813ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 620133bb-27bf-438d-9c59-fa59b3362b91 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-752edbda008&vpc=default
34862024-11-27T18:34:50.815ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 620133bb-27bf-438d-9c59-fa59b3362b91 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-752edbda008&vpc=default
34872024-11-27T18:34:50.815ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 620133bb-27bf-438d-9c59-fa59b3362b91 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-752edbda008&vpc=default
34882024-11-27T18:34:50.817ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 620133bb-27bf-438d-9c59-fa59b3362b91 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-752edbda008&vpc=default
34892024-11-27T18:34:50.817ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 620133bb-27bf-438d-9c59-fa59b3362b91 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-752edbda008&vpc=default
34902024-11-27T18:34:50.818ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 620133bb-27bf-438d-9c59-fa59b3362b91 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-752edbda008&vpc=default
34912024-11-27T18:34:50.819ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 620133bb-27bf-438d-9c59-fa59b3362b91 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-752edbda008&vpc=default
34922024-11-27T18:34:50.821ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 620133bb-27bf-438d-9c59-fa59b3362b91 roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } uri = /v1/vpc-subnets/default?project=proj-752edbda008&vpc=default
34932024-11-27T18:34:50.824ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 620133bb-27bf-438d-9c59-fa59b3362b91 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba, lookup_type: ByName("proj-752edbda008") }, key: c95295a8-b909-41a6-ac8c-0f3016565054, lookup_type: ByName("default") }, key: 11a84d5b-ffe8-4a54-89f4-11e668422030, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-752edbda008&vpc=default
34942024-11-27T18:34:50.824ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 620133bb-27bf-438d-9c59-fa59b3362b91 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-752edbda008&vpc=default
34952024-11-27T18:34:50.824ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 620133bb-27bf-438d-9c59-fa59b3362b91 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-752edbda008&vpc=default
34962024-11-27T18:34:50.827ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 620133bb-27bf-438d-9c59-fa59b3362b91 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-752edbda008&vpc=default
34972024-11-27T18:34:50.827ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 620133bb-27bf-438d-9c59-fa59b3362b91 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-752edbda008&vpc=default
34982024-11-27T18:34:50.829ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 620133bb-27bf-438d-9c59-fa59b3362b91 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-752edbda008&vpc=default
34992024-11-27T18:34:50.829ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 620133bb-27bf-438d-9c59-fa59b3362b91 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-752edbda008&vpc=default
35002024-11-27T18:34:50.831ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 620133bb-27bf-438d-9c59-fa59b3362b91 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-752edbda008&vpc=default
35012024-11-27T18:34:50.831ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 620133bb-27bf-438d-9c59-fa59b3362b91 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-752edbda008&vpc=default
35022024-11-27T18:34:50.833ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 620133bb-27bf-438d-9c59-fa59b3362b91 roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } uri = /v1/vpc-subnets/default?project=proj-752edbda008&vpc=default
35032024-11-27T18:34:50.836ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 620133bb-27bf-438d-9c59-fa59b3362b91 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba, lookup_type: ByName("proj-752edbda008") }, key: c95295a8-b909-41a6-ac8c-0f3016565054, lookup_type: ByName("default") }, key: 11a84d5b-ffe8-4a54-89f4-11e668422030, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-752edbda008&vpc=default
35042024-11-27T18:34:50.836ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 620133bb-27bf-438d-9c59-fa59b3362b91 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-752edbda008&vpc=default
35052024-11-27T18:34:50.836ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 620133bb-27bf-438d-9c59-fa59b3362b91 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-752edbda008&vpc=default
35062024-11-27T18:34:50.838ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 620133bb-27bf-438d-9c59-fa59b3362b91 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-752edbda008&vpc=default
35072024-11-27T18:34:50.838ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 620133bb-27bf-438d-9c59-fa59b3362b91 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-752edbda008&vpc=default
35082024-11-27T18:34:50.844ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 620133bb-27bf-438d-9c59-fa59b3362b91 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-752edbda008&vpc=default
35092024-11-27T18:34:50.844ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 620133bb-27bf-438d-9c59-fa59b3362b91 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-752edbda008&vpc=default
35102024-11-27T18:34:50.852ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 620133bb-27bf-438d-9c59-fa59b3362b91 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-752edbda008&vpc=default
35112024-11-27T18:34:50.852ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 620133bb-27bf-438d-9c59-fa59b3362b91 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-752edbda008&vpc=default
35122024-11-27T18:34:50.856ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82058 local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 620133bb-27bf-438d-9c59-fa59b3362b91 response_code = 204 uri = /v1/vpc-subnets/default?project=proj-752edbda008&vpc=default
35132024-11-27T18:34:50.856ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 2 reason = Signaled
35142024-11-27T18:34:50.856ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
35152024-11-27T18:34:50.856ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35162024-11-27T18:34:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35172024-11-27T18:34:50.857ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35182024-11-27T18:34:50.857ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35192024-11-27T18:34:50.857ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35202024-11-27T18:34:50.859ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35212024-11-27T18:34:50.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35222024-11-27T18:34:50.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35232024-11-27T18:34:50.861ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35242024-11-27T18:34:50.861ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35252024-11-27T18:34:50.861ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35262024-11-27T18:34:50.862ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
35272024-11-27T18:34:50.862ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35282024-11-27T18:34:50.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35292024-11-27T18:34:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35302024-11-27T18:34:50.863ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "e736b427937bfa233f37989e8bdecb952a09e936", lookup_type: ByCompositeId("token = \\"e736b427937bfa233f37989e8bdecb952a09e936\\"") } result = Ok(())
35312024-11-27T18:34:50.863ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35322024-11-27T18:34:50.864ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35332024-11-27T18:34:50.864ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35342024-11-27T18:34:50.865ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35352024-11-27T18:34:50.866ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35362024-11-27T18:34:50.866ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35372024-11-27T18:34:50.867ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35382024-11-27T18:34:50.868ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35392024-11-27T18:34:50.869ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
35402024-11-27T18:34:50.870ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, lookup_type: ById(0b2a0ba2-c679-4886-a1b8-ae9858bb938c) } result = Ok(())
35412024-11-27T18:34:50.870ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35422024-11-27T18:34:50.870ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35432024-11-27T18:34:50.872ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
35442024-11-27T18:34:50.873ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "e736b427937bfa233f37989e8bdecb952a09e936", lookup_type: ByCompositeId("e736b427937bfa233f37989e8bdecb952a09e936") } result = Ok(())
35452024-11-27T18:34:50.873ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35462024-11-27T18:34:50.873ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35472024-11-27T18:34:50.876ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35482024-11-27T18:34:50.876ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35492024-11-27T18:34:50.878ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35502024-11-27T18:34:50.878ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35512024-11-27T18:34:50.880ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35522024-11-27T18:34:50.880ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35532024-11-27T18:34:50.881ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35542024-11-27T18:34:50.881ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35552024-11-27T18:34:50.884ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
35562024-11-27T18:34:50.886ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, lookup_type: ById(0b2a0ba2-c679-4886-a1b8-ae9858bb938c) } result = Ok(())
35572024-11-27T18:34:50.886ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35582024-11-27T18:34:50.886ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35592024-11-27T18:34:50.887ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35602024-11-27T18:34:50.887ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35612024-11-27T18:34:50.889ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35622024-11-27T18:34:50.889ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35632024-11-27T18:34:50.890ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
35642024-11-27T18:34:50.891ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) } result = Ok(())
35652024-11-27T18:34:50.891ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-752edbda008
35662024-11-27T18:34:50.891ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-752edbda008
35672024-11-27T18:34:50.893ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-752edbda008
35682024-11-27T18:34:50.893ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-752edbda008
35692024-11-27T18:34:50.894ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-752edbda008
35702024-11-27T18:34:50.895ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-752edbda008
35712024-11-27T18:34:50.896ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-752edbda008
35722024-11-27T18:34:50.896ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-752edbda008
35732024-11-27T18:34:50.898ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-752edbda008
35742024-11-27T18:34:50.898ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-752edbda008
35752024-11-27T18:34:50.901ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-752edbda008
35762024-11-27T18:34:50.901ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-752edbda008
35772024-11-27T18:34:50.903ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-752edbda008
35782024-11-27T18:34:50.903ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-752edbda008
35792024-11-27T18:34:50.905ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } uri = /v1/vpcs/default?project=proj-752edbda008
35802024-11-27T18:34:50.909ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba, lookup_type: ByName("proj-752edbda008") }, key: c95295a8-b909-41a6-ac8c-0f3016565054, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-752edbda008
35812024-11-27T18:34:50.909ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-752edbda008
35822024-11-27T18:34:50.909ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-752edbda008
35832024-11-27T18:34:50.911ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-752edbda008
35842024-11-27T18:34:50.911ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-752edbda008
35852024-11-27T18:34:50.913ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-752edbda008
35862024-11-27T18:34:50.913ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-752edbda008
35872024-11-27T18:34:50.916ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-752edbda008
35882024-11-27T18:34:50.916ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-752edbda008
35892024-11-27T18:34:50.918ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } uri = /v1/vpcs/default?project=proj-752edbda008
35902024-11-27T18:34:50.921ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba, lookup_type: ByName("proj-752edbda008") }, key: c95295a8-b909-41a6-ac8c-0f3016565054, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-752edbda008
35912024-11-27T18:34:50.921ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-752edbda008
35922024-11-27T18:34:50.921ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-752edbda008
35932024-11-27T18:34:50.935ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
35942024-11-27T18:34:50.935ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35952024-11-27T18:34:50.936ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b127946-43eb-41a6-bb41-b2907809ad5f", "content-length": "312", "date": "Wed, 27 Nov 2024 18:34:50 GMT"} })
35962024-11-27T18:34:50.936ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35972024-11-27T18:34:50.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35982024-11-27T18:34:50.937ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-752edbda008
35992024-11-27T18:34:50.937ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-752edbda008
36002024-11-27T18:34:50.941ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-752edbda008
36012024-11-27T18:34:50.941ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-752edbda008
36022024-11-27T18:34:50.943ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-752edbda008
36032024-11-27T18:34:50.943ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-752edbda008
36042024-11-27T18:34:50.945ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-752edbda008
36052024-11-27T18:34:50.945ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-752edbda008
36062024-11-27T18:34:50.947ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-752edbda008
36072024-11-27T18:34:50.948ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-752edbda008
36082024-11-27T18:34:50.950ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } uri = /v1/vpcs/default?project=proj-752edbda008
36092024-11-27T18:34:50.950ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
36102024-11-27T18:34:50.950ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
36112024-11-27T18:34:50.951ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d4abbe2a-28f6-4c25-bd85-1ea2fc05d92e", "date": "Wed, 27 Nov 2024 18:34:50 GMT"} })
36122024-11-27T18:34:50.951ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36132024-11-27T18:34:50.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36142024-11-27T18:34:50.953ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba, lookup_type: ByName("proj-752edbda008") }, key: c95295a8-b909-41a6-ac8c-0f3016565054, lookup_type: ByName("default") }, key: 6fead121-f52b-4251-93b3-a9d36fbbe9c4, lookup_type: ById(6fead121-f52b-4251-93b3-a9d36fbbe9c4) } result = Ok(()) uri = /v1/vpcs/default?project=proj-752edbda008
36152024-11-27T18:34:50.953ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-752edbda008
36162024-11-27T18:34:50.953ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36172024-11-27T18:34:50.954ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-752edbda008
36182024-11-27T18:34:50.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36192024-11-27T18:34:50.959ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36202024-11-27T18:34:50.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36212024-11-27T18:34:50.960ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-752edbda008
36222024-11-27T18:34:50.960ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-752edbda008
36232024-11-27T18:34:50.962ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36242024-11-27T18:34:50.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36252024-11-27T18:34:50.963ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-752edbda008
36262024-11-27T18:34:50.964ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-752edbda008
36272024-11-27T18:34:50.964ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36282024-11-27T18:34:50.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36292024-11-27T18:34:50.965ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36302024-11-27T18:34:50.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36312024-11-27T18:34:50.966ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-752edbda008
36322024-11-27T18:34:50.967ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-752edbda008
36332024-11-27T18:34:50.967ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36342024-11-27T18:34:50.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36352024-11-27T18:34:50.968ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-752edbda008
36362024-11-27T18:34:50.968ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36372024-11-27T18:34:50.968ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-752edbda008
36382024-11-27T18:34:50.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36392024-11-27T18:34:50.970ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36402024-11-27T18:34:50.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36412024-11-27T18:34:50.971ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-752edbda008
36422024-11-27T18:34:50.971ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-752edbda008
36432024-11-27T18:34:50.971ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36442024-11-27T18:34:50.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36452024-11-27T18:34:50.972ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-752edbda008
36462024-11-27T18:34:50.972ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-752edbda008
36472024-11-27T18:34:50.973ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36482024-11-27T18:34:50.975ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } uri = /v1/vpcs/default?project=proj-752edbda008
36492024-11-27T18:34:50.977ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
36502024-11-27T18:34:50.977ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36512024-11-27T18:34:50.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36522024-11-27T18:34:50.978ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba, lookup_type: ByName("proj-752edbda008") }, key: c95295a8-b909-41a6-ac8c-0f3016565054, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-752edbda008
36532024-11-27T18:34:50.978ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-752edbda008
36542024-11-27T18:34:50.978ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-752edbda008
36552024-11-27T18:34:50.979ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36562024-11-27T18:34:50.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36572024-11-27T18:34:50.980ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36582024-11-27T18:34:50.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36592024-11-27T18:34:50.981ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36602024-11-27T18:34:50.983ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125641 local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = bd50b401-07e3-42dd-8852-5bc50362f1a7 response_code = 204 uri = /v1/vpcs/default?project=proj-752edbda008
36612024-11-27T18:34:50.983ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
36622024-11-27T18:34:50.984ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
36632024-11-27T18:34:50.985ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
36642024-11-27T18:34:50.985ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
36652024-11-27T18:34:50.985ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
36662024-11-27T18:34:50.985ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36672024-11-27T18:34:50.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36682024-11-27T18:34:50.986ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
36692024-11-27T18:34:50.987ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "e736b427937bfa233f37989e8bdecb952a09e936", lookup_type: ByCompositeId("token = \\"e736b427937bfa233f37989e8bdecb952a09e936\\"") } result = Ok(())
36702024-11-27T18:34:50.987ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
36712024-11-27T18:34:50.987ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
36722024-11-27T18:34:50.988ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36732024-11-27T18:34:50.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36742024-11-27T18:34:50.988ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
36752024-11-27T18:34:50.988ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
36762024-11-27T18:34:50.989ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36772024-11-27T18:34:50.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36782024-11-27T18:34:50.990ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
36792024-11-27T18:34:50.990ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
36802024-11-27T18:34:50.991ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36812024-11-27T18:34:50.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36822024-11-27T18:34:50.991ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
36832024-11-27T18:34:50.991ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
36842024-11-27T18:34:50.992ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36852024-11-27T18:34:50.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36862024-11-27T18:34:50.992ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
36872024-11-27T18:34:50.993ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36882024-11-27T18:34:50.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36892024-11-27T18:34:50.994ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, lookup_type: ById(0b2a0ba2-c679-4886-a1b8-ae9858bb938c) } result = Ok(())
36902024-11-27T18:34:50.994ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
36912024-11-27T18:34:50.994ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
36922024-11-27T18:34:50.995ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36932024-11-27T18:34:50.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36942024-11-27T18:34:50.995ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
36952024-11-27T18:34:50.996ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36962024-11-27T18:34:50.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36972024-11-27T18:34:50.996ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "e736b427937bfa233f37989e8bdecb952a09e936", lookup_type: ByCompositeId("e736b427937bfa233f37989e8bdecb952a09e936") } result = Ok(())
36982024-11-27T18:34:50.996ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
36992024-11-27T18:34:50.996ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37002024-11-27T18:34:50.997ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37012024-11-27T18:34:50.999ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37022024-11-27T18:34:50.999ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37032024-11-27T18:34:51.000ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37042024-11-27T18:34:51.001ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37052024-11-27T18:34:51.001ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000003, lookup_type: ByName("boundary-ntp") } result = Ok(())
37062024-11-27T18:34:51.001ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37072024-11-27T18:34:51.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37082024-11-27T18:34:51.002ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37092024-11-27T18:34:51.002ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37102024-11-27T18:34:51.002ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37112024-11-27T18:34:51.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37122024-11-27T18:34:51.003ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37132024-11-27T18:34:51.003ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37142024-11-27T18:34:51.003ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37152024-11-27T18:34:51.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37162024-11-27T18:34:51.005ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
37172024-11-27T18:34:51.005ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37182024-11-27T18:34:51.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37192024-11-27T18:34:51.006ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, lookup_type: ById(0b2a0ba2-c679-4886-a1b8-ae9858bb938c) } result = Ok(())
37202024-11-27T18:34:51.006ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37212024-11-27T18:34:51.006ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37222024-11-27T18:34:51.007ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37232024-11-27T18:34:51.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37242024-11-27T18:34:51.007ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37252024-11-27T18:34:51.007ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37262024-11-27T18:34:51.008ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37272024-11-27T18:34:51.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37282024-11-27T18:34:51.008ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37292024-11-27T18:34:51.009ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37302024-11-27T18:34:51.010ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37312024-11-27T18:34:51.010ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
37322024-11-27T18:34:51.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37332024-11-27T18:34:51.011ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) } result = Ok(())
37342024-11-27T18:34:51.011ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd roles = RoleSet { roles: {} } uri = /v1/projects/proj-752edbda008
37352024-11-27T18:34:51.011ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd resource = Database result = Ok(()) uri = /v1/projects/proj-752edbda008
37362024-11-27T18:34:51.011ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37372024-11-27T18:34:51.012ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd roles = RoleSet { roles: {} } uri = /v1/projects/proj-752edbda008
37382024-11-27T18:34:51.012ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd resource = Database result = Ok(()) uri = /v1/projects/proj-752edbda008
37392024-11-27T18:34:51.014ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd roles = RoleSet { roles: {} } uri = /v1/projects/proj-752edbda008
37402024-11-27T18:34:51.014ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd resource = Database result = Ok(()) uri = /v1/projects/proj-752edbda008
37412024-11-27T18:34:51.014ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
37422024-11-27T18:34:51.014ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37432024-11-27T18:34:51.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37442024-11-27T18:34:51.015ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37452024-11-27T18:34:51.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37462024-11-27T18:34:51.016ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd roles = RoleSet { roles: {} } uri = /v1/projects/proj-752edbda008
37472024-11-27T18:34:51.016ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd resource = Database result = Ok(()) uri = /v1/projects/proj-752edbda008
37482024-11-27T18:34:51.017ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37492024-11-27T18:34:51.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37502024-11-27T18:34:51.018ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37512024-11-27T18:34:51.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37522024-11-27T18:34:51.019ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd roles = RoleSet { roles: {} } uri = /v1/projects/proj-752edbda008
37532024-11-27T18:34:51.019ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd resource = Database result = Ok(()) uri = /v1/projects/proj-752edbda008
37542024-11-27T18:34:51.019ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37552024-11-27T18:34:51.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37562024-11-27T18:34:51.020ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd roles = RoleSet { roles: {} } uri = /v1/projects/proj-752edbda008
37572024-11-27T18:34:51.020ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37582024-11-27T18:34:51.020ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd resource = Database result = Ok(()) uri = /v1/projects/proj-752edbda008
37592024-11-27T18:34:51.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37602024-11-27T18:34:51.022ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37612024-11-27T18:34:51.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37622024-11-27T18:34:51.023ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } uri = /v1/projects/proj-752edbda008
37632024-11-27T18:34:51.023ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37642024-11-27T18:34:51.025ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd resource = Project { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba, lookup_type: ByName("proj-752edbda008") } result = Ok(()) uri = /v1/projects/proj-752edbda008
37652024-11-27T18:34:51.025ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd roles = RoleSet { roles: {} } uri = /v1/projects/proj-752edbda008
37662024-11-27T18:34:51.025ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd resource = Database result = Ok(()) uri = /v1/projects/proj-752edbda008
37672024-11-27T18:34:51.027ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd roles = RoleSet { roles: {} } uri = /v1/projects/proj-752edbda008
37682024-11-27T18:34:51.027ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd resource = Database result = Ok(()) uri = /v1/projects/proj-752edbda008
37692024-11-27T18:34:51.027ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
37702024-11-27T18:34:51.027ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37712024-11-27T18:34:51.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37722024-11-27T18:34:51.028ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37732024-11-27T18:34:51.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37742024-11-27T18:34:51.029ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd roles = RoleSet { roles: {} } uri = /v1/projects/proj-752edbda008
37752024-11-27T18:34:51.029ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd resource = Database result = Ok(()) uri = /v1/projects/proj-752edbda008
37762024-11-27T18:34:51.030ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37772024-11-27T18:34:51.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37782024-11-27T18:34:51.031ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37792024-11-27T18:34:51.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37802024-11-27T18:34:51.031ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd roles = RoleSet { roles: {} } uri = /v1/projects/proj-752edbda008
37812024-11-27T18:34:51.032ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd resource = Database result = Ok(()) uri = /v1/projects/proj-752edbda008
37822024-11-27T18:34:51.033ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37832024-11-27T18:34:51.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37842024-11-27T18:34:51.034ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd roles = RoleSet { roles: {(Silo, 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, "admin")} } uri = /v1/projects/proj-752edbda008
37852024-11-27T18:34:51.034ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37862024-11-27T18:34:51.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37872024-11-27T18:34:51.036ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd resource = Project { parent: Silo { parent: Fleet, key: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, lookup_type: ById(40016410-ac98-42a3-b0ca-e7ce46b4e8ba) }, key: 1ca8f47d-af2e-41ac-84cc-d0e8c4b08bba, lookup_type: ByName("proj-752edbda008") } result = Ok(()) uri = /v1/projects/proj-752edbda008
37882024-11-27T18:34:51.036ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd roles = RoleSet { roles: {} } uri = /v1/projects/proj-752edbda008
37892024-11-27T18:34:51.036ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd resource = Database result = Ok(()) uri = /v1/projects/proj-752edbda008
37902024-11-27T18:34:51.036ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37912024-11-27T18:34:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37922024-11-27T18:34:51.037ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37932024-11-27T18:34:51.037ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd roles = RoleSet { roles: {} } uri = /v1/projects/proj-752edbda008
37942024-11-27T18:34:51.037ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd resource = Database result = Ok(()) uri = /v1/projects/proj-752edbda008
37952024-11-27T18:34:51.039ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd roles = RoleSet { roles: {} } uri = /v1/projects/proj-752edbda008
37962024-11-27T18:34:51.040ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd resource = Database result = Ok(()) uri = /v1/projects/proj-752edbda008
37972024-11-27T18:34:51.041ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000002, lookup_type: ByName("default") } result = Ok(())
37982024-11-27T18:34:51.041ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37992024-11-27T18:34:51.044ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b7374b04-53d4-4a00-923d-9f46b1cff9ea", "date": "Wed, 27 Nov 2024 18:34:50 GMT"} })
38002024-11-27T18:34:51.045ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 189.098763ms iteration = 2 status = {}
38012024-11-27T18:34:51.051ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd roles = RoleSet { roles: {} } uri = /v1/projects/proj-752edbda008
38022024-11-27T18:34:51.051ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd resource = Database result = Ok(()) uri = /v1/projects/proj-752edbda008
38032024-11-27T18:34:51.058ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd roles = RoleSet { roles: {} } uri = /v1/projects/proj-752edbda008
38042024-11-27T18:34:51.058ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd resource = Database result = Ok(()) uri = /v1/projects/proj-752edbda008
38052024-11-27T18:34:51.060ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd roles = RoleSet { roles: {} } uri = /v1/projects/proj-752edbda008
38062024-11-27T18:34:51.060ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd resource = Database result = Ok(()) uri = /v1/projects/proj-752edbda008
38072024-11-27T18:34:51.062ZDEBGnexus (dropshot_external): roles actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd roles = RoleSet { roles: {} } uri = /v1/projects/proj-752edbda008
38082024-11-27T18:34:51.062ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 0b2a0ba2-c679-4886-a1b8-ae9858bb938c, silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, .. }) actor_id = 0b2a0ba2-c679-4886-a1b8-ae9858bb938c authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd resource = Database result = Ok(()) uri = /v1/projects/proj-752edbda008
38092024-11-27T18:34:51.069ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86021 local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:40247 req_id = 6ae448d4-0dd7-4b95-a534-981cfc7d0fdd response_code = 204 uri = /v1/projects/proj-752edbda008
38102024-11-27T18:34:51.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 3 reason = Timeout
38112024-11-27T18:34:51.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 3 reason = Timeout
38122024-11-27T18:34:51.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38132024-11-27T18:34:51.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38142024-11-27T18:34:51.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38152024-11-27T18:34:51.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38162024-11-27T18:34:51.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38172024-11-27T18:34:51.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38182024-11-27T18:34:51.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38192024-11-27T18:34:51.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38202024-11-27T18:34:51.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38212024-11-27T18:34:51.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38222024-11-27T18:34:51.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38232024-11-27T18:34:51.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
38242024-11-27T18:34:51.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38252024-11-27T18:34:51.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38262024-11-27T18:34:51.607ZINFOnexus (BackgroundTasks): found new target blueprint (first find) background_task = blueprint_loader file = nexus/src/app/background/tasks/blueprint_load.rs:88 target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
38272024-11-27T18:34:51.607ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 33.405055ms iteration = 3 status = {"enabled":false,"status":"first target blueprint","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z","time_found":"2024-11-27T18:34:51.607382751Z"}
38282024-11-27T18:34:51.607ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 2 reason = Dependency
38292024-11-27T18:34:51.607ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 2 reason = Dependency
38302024-11-27T18:34:51.607ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 4ce244bc-1034-4855-877d-76a08bc15b71
38312024-11-27T18:34:51.607ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 7.671\u{b5}s iteration = 2 status = {"enabled":false,"target_id":"4ce244bc-1034-4855-877d-76a08bc15b71"}
38322024-11-27T18:34:51.607ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38332024-11-27T18:34:51.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38342024-11-27T18:34:51.607ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38352024-11-27T18:34:51.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38362024-11-27T18:34:51.607ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38372024-11-27T18:34:51.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38382024-11-27T18:34:51.608ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38392024-11-27T18:34:51.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38402024-11-27T18:34:51.608ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38412024-11-27T18:34:51.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38422024-11-27T18:34:51.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38432024-11-27T18:34:51.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38442024-11-27T18:34:51.610ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38452024-11-27T18:34:51.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
38462024-11-27T18:34:51.612ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38472024-11-27T18:34:51.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38482024-11-27T18:34:51.612ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38492024-11-27T18:34:51.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
38502024-11-27T18:34:51.614ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38512024-11-27T18:34:51.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38522024-11-27T18:34:51.614ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38532024-11-27T18:34:51.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
38542024-11-27T18:34:51.615ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38552024-11-27T18:34:51.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38562024-11-27T18:34:51.616ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38572024-11-27T18:34:51.618ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
38582024-11-27T18:34:51.618ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38592024-11-27T18:34:51.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38602024-11-27T18:34:51.618ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38612024-11-27T18:34:51.620ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
38622024-11-27T18:34:51.620ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38632024-11-27T18:34:51.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38642024-11-27T18:34:51.641ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 67.632523ms iteration = 3 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38652024-11-27T18:34:51.651ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::7]:32222/node/id
38662024-11-27T18:34:51.684ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::3]:32222/node/id
38672024-11-27T18:34:51.716ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::5]:32222/node/id
38682024-11-27T18:34:51.747ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::6]:32222/node/id
38692024-11-27T18:34:51.779ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::4]:32222/node/id
38702024-11-27T18:34:52.523ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b8dc7665-0ee3-4fe1-ac4b-f815d3c457a5", "content-length": "64", "date": "Wed, 27 Nov 2024 18:34:52 GMT"} })
38712024-11-27T18:34:52.523ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38722024-11-27T18:34:52.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38732024-11-27T18:34:52.525ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38742024-11-27T18:34:52.526ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
38752024-11-27T18:34:52.526ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38762024-11-27T18:34:52.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38772024-11-27T18:34:52.605ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5e62ce9-a734-4f91-b673-78ecefb1c95b", "content-length": "64", "date": "Wed, 27 Nov 2024 18:34:52 GMT"} })
38782024-11-27T18:34:52.605ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38792024-11-27T18:34:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38802024-11-27T18:34:52.607ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38812024-11-27T18:34:52.608ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
38822024-11-27T18:34:52.608ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38832024-11-27T18:34:52.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38842024-11-27T18:34:52.616ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "df1ebdd1-2c9a-45d1-8ada-787b9470f52a", "content-length": "64", "date": "Wed, 27 Nov 2024 18:34:52 GMT"} })
38852024-11-27T18:34:52.616ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38862024-11-27T18:34:52.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38872024-11-27T18:34:52.618ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38882024-11-27T18:34:52.619ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
38892024-11-27T18:34:52.619ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38902024-11-27T18:34:52.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38912024-11-27T18:34:52.620ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c08f9e1-ee49-4979-94e3-460364a3f865", "content-length": "64", "date": "Wed, 27 Nov 2024 18:34:52 GMT"} })
38922024-11-27T18:34:52.620ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38932024-11-27T18:34:52.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38942024-11-27T18:34:52.621ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38952024-11-27T18:34:52.623ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
38962024-11-27T18:34:52.623ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38972024-11-27T18:34:52.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38982024-11-27T18:34:52.637ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac7ad968-cd33-4121-abe1-cc546aed8b73", "content-length": "64", "date": "Wed, 27 Nov 2024 18:34:52 GMT"} })
38992024-11-27T18:34:52.637ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39002024-11-27T18:34:52.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39012024-11-27T18:34:52.638ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39022024-11-27T18:34:52.640ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
39032024-11-27T18:34:52.640ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39042024-11-27T18:34:52.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39052024-11-27T18:34:52.645ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 1.038010586s iteration = 2 status = {"nsuccess":5}
39062024-11-27T18:34:53.810ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:37281
39072024-11-27T18:34:53.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37281 req_id = 0fc8c459-91b0-4c5d-b6ca-eace7a610047 roles = RoleSet { roles: {} } uri = /metrics/producers
39082024-11-27T18:34:53.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37281 req_id = 0fc8c459-91b0-4c5d-b6ca-eace7a610047 resource = Database result = Ok(()) uri = /metrics/producers
39092024-11-27T18:34:53.953ZINFOnexus: assigned collector to new producer collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:76 producer_id = 761834fc-a72f-4e26-9e1f-c4047ccf5da9
39102024-11-27T18:34:53.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142445 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37281 req_id = 0fc8c459-91b0-4c5d-b6ca-eace7a610047 response_code = 201 uri = /metrics/producers
39112024-11-27T18:34:56.945ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:42000
39122024-11-27T18:34:56.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42000 req_id = e30c4ad2-a6f5-429d-baac-345c548f3ac5 roles = RoleSet { roles: {} } uri = /metrics/producers
39132024-11-27T18:34:56.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42000 req_id = e30c4ad2-a6f5-429d-baac-345c548f3ac5 resource = Database result = Ok(()) uri = /metrics/producers
39142024-11-27T18:34:56.958ZINFOnexus: assigned collector to new producer collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:76 producer_id = f3f7f234-938f-4eb4-84cd-9acd73e59924
39152024-11-27T18:34:56.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9488 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42000 req_id = e30c4ad2-a6f5-429d-baac-345c548f3ac5 response_code = 201 uri = /metrics/producers
39162024-11-27T18:34:58.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49565 req_id = 8eb40e20-ee30-4a39-b255-5ec548a1b67e roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
39172024-11-27T18:34:58.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49565 req_id = 8eb40e20-ee30-4a39-b255-5ec548a1b67e resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
39182024-11-27T18:34:58.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59130 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49565 req_id = 8eb40e20-ee30-4a39-b255-5ec548a1b67e response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
39192024-11-27T18:34:58.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49565 req_id = 7e8f7845-fe39-4475-8677-fda399d94bf7 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmM2Y3ZjIzNC05MzhmLTRlYjQtODRjZC05YWNkNzNlNTk5MjQifX0%3D
39202024-11-27T18:34:58.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49565 req_id = 7e8f7845-fe39-4475-8677-fda399d94bf7 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmM2Y3ZjIzNC05MzhmLTRlYjQtODRjZC05YWNkNzNlNTk5MjQifX0%3D
39212024-11-27T18:34:58.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107878 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49565 req_id = 7e8f7845-fe39-4475-8677-fda399d94bf7 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmM2Y3ZjIzNC05MzhmLTRlYjQtODRjZC05YWNkNzNlNTk5MjQifX0%3D
39222024-11-27T18:34:58.895ZINFOnexus (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:33512 remote_addr = [fd00:1122:3344:101::d]:47845
39232024-11-27T18:34:58.901ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5590 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 68933eca-b009-4964-b800-0b528a08259c response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
39242024-11-27T18:35:00.778ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:45729
39252024-11-27T18:35:00.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45729 req_id = cdeddd58-aa76-4a99-aa9e-b856a8fef505 roles = RoleSet { roles: {} } uri = /metrics/producers
39262024-11-27T18:35:00.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45729 req_id = cdeddd58-aa76-4a99-aa9e-b856a8fef505 resource = Database result = Ok(()) uri = /metrics/producers
39272024-11-27T18:35:00.790ZINFOnexus: assigned collector to new producer collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:76 producer_id = b844cfb5-ff43-41f6-a61d-f7949f48466b
39282024-11-27T18:35:00.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11730 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45729 req_id = cdeddd58-aa76-4a99-aa9e-b856a8fef505 response_code = 201 uri = /metrics/producers
39292024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 2 reason = Timeout
39302024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
39312024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 2 reason = Timeout
39322024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39332024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 4 reason = Timeout
39342024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 2 reason = Timeout
39352024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39362024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39372024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 2 reason = Timeout
39382024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 3 reason = Timeout
39392024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
39402024-11-27T18:35:01.574ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
39412024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39422024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 4 reason = Timeout
39432024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39442024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39452024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 2 reason = Timeout
39462024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 2 reason = Timeout
39472024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
39482024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 2 reason = Timeout
39492024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 2 reason = Timeout
39502024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39512024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 2 reason = Timeout
39522024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39532024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 4 reason = Timeout
39542024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39552024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 2 reason = Timeout
39562024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39572024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39582024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 2 reason = Timeout
39592024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
39602024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 2 reason = Timeout
39612024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
39622024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 2 reason = Timeout
39632024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39642024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39652024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39662024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39672024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39682024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39692024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
39702024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
39712024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39722024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39732024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39742024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39752024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39762024-11-27T18:35:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
39772024-11-27T18:35:01.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39782024-11-27T18:35:01.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
39792024-11-27T18:35:01.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39802024-11-27T18:35:01.577ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39812024-11-27T18:35:01.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39822024-11-27T18:35:01.577ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.35747ms iteration = 2 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
39832024-11-27T18:35:01.577ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39842024-11-27T18:35:01.578ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39852024-11-27T18:35:01.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39862024-11-27T18:35:01.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
39872024-11-27T18:35:01.579ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39882024-11-27T18:35:01.580ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2135, tv_nsec: 578426183 } })
39892024-11-27T18:35:01.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39902024-11-27T18:35:01.580ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
39912024-11-27T18:35:01.580ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39922024-11-27T18:35:01.580ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39932024-11-27T18:35:01.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39942024-11-27T18:35:01.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39952024-11-27T18:35:01.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39962024-11-27T18:35:01.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39972024-11-27T18:35:01.582ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2135, tv_nsec: 581248064 } })
39982024-11-27T18:35:01.583ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
39992024-11-27T18:35:01.585ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40002024-11-27T18:35:01.586ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40012024-11-27T18:35:01.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
40022024-11-27T18:35:01.588ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40032024-11-27T18:35:01.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40042024-11-27T18:35:01.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
40052024-11-27T18:35:01.589ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40062024-11-27T18:35:01.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40072024-11-27T18:35:01.589ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40082024-11-27T18:35:01.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40092024-11-27T18:35:01.592ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40102024-11-27T18:35:01.593ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40112024-11-27T18:35:01.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40122024-11-27T18:35:01.593ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40132024-11-27T18:35:01.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40142024-11-27T18:35:01.594ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40152024-11-27T18:35:01.594ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40162024-11-27T18:35:01.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40172024-11-27T18:35:01.602ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
40182024-11-27T18:35:01.602ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 28.34365ms iteration = 2 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
40192024-11-27T18:35:01.622ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40202024-11-27T18:35:01.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40212024-11-27T18:35:01.626ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40222024-11-27T18:35:01.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40232024-11-27T18:35:01.628ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40242024-11-27T18:35:01.628ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40252024-11-27T18:35:01.631ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40262024-11-27T18:35:01.631ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40272024-11-27T18:35:01.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40282024-11-27T18:35:01.631ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 56.949824ms iteration = 2 status = {"errors":[],"garbage_collect_requested":[]}
40292024-11-27T18:35:01.632ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
40302024-11-27T18:35:01.632ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40312024-11-27T18:35:01.632ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40322024-11-27T18:35:01.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40332024-11-27T18:35:01.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40342024-11-27T18:35:01.635ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40352024-11-27T18:35:01.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40362024-11-27T18:35:01.638ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40372024-11-27T18:35:01.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40382024-11-27T18:35:01.639ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 65.313438ms iteration = 2 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
40392024-11-27T18:35:01.639ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40402024-11-27T18:35:01.639ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
40412024-11-27T18:35:01.639ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40422024-11-27T18:35:01.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40432024-11-27T18:35:01.642ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 67.864446ms iteration = 2 status = {"errors":[],"records_set_to_done":[]}
40442024-11-27T18:35:01.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40452024-11-27T18:35:01.644ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40462024-11-27T18:35:01.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40472024-11-27T18:35:01.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
40482024-11-27T18:35:01.646ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40492024-11-27T18:35:01.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40502024-11-27T18:35:01.653ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
40512024-11-27T18:35:01.654ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40522024-11-27T18:35:01.654ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "773f868c-be2f-4b93-a235-7876c30ff80f", "content-length": "26", "date": "Wed, 27 Nov 2024 18:35:01 GMT"} })
40532024-11-27T18:35:01.654ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40542024-11-27T18:35:01.655ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40552024-11-27T18:35:01.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40562024-11-27T18:35:01.655ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40572024-11-27T18:35:01.657ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 82.548344ms iteration = 2 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
40582024-11-27T18:35:01.659ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2135, tv_nsec: 658092584 } })
40592024-11-27T18:35:01.660ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1103
40602024-11-27T18:35:01.664ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 89.757031ms iteration = 4 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40612024-11-27T18:35:01.665ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
40622024-11-27T18:35:01.665ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40632024-11-27T18:35:01.665ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c800909-187f-4714-beca-adcc66f85777", "content-length": "26", "date": "Wed, 27 Nov 2024 18:35:01 GMT"} })
40642024-11-27T18:35:01.665ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40652024-11-27T18:35:01.666ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
40662024-11-27T18:35:01.666ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 92.095425ms iteration = 4 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
40672024-11-27T18:35:01.667ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40682024-11-27T18:35:01.677ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40692024-11-27T18:35:01.677ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
40702024-11-27T18:35:01.677ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40712024-11-27T18:35:01.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40722024-11-27T18:35:01.678ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 104.410717ms iteration = 2 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
40732024-11-27T18:35:01.688ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2135, tv_nsec: 686527965 } })
40742024-11-27T18:35:01.688ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
40752024-11-27T18:35:01.710ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40762024-11-27T18:35:01.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40772024-11-27T18:35:01.716ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40782024-11-27T18:35:01.716ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
40792024-11-27T18:35:01.716ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 141.895773ms iteration = 2 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
40802024-11-27T18:35:01.723ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40812024-11-27T18:35:01.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40822024-11-27T18:35:01.741ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40832024-11-27T18:35:01.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40842024-11-27T18:35:01.756ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
40852024-11-27T18:35:01.756ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e6c81ecd-48ce-4aae-b239-ba9b3654b73f", "content-length": "1", "date": "Wed, 27 Nov 2024 18:35:01 GMT"} })
40862024-11-27T18:35:01.757ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
40872024-11-27T18:35:01.757ZDEBGnexus (MgsClient): client request background_task = service_zone_nat_tracker body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40882024-11-27T18:35:01.757ZDEBGnexus (MgsClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a19e426e-1b3d-491f-ae10-a2915ba71338", "content-length": "26", "date": "Wed, 27 Nov 2024 18:35:01 GMT"} })
40892024-11-27T18:35:01.757ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40902024-11-27T18:35:01.758ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40912024-11-27T18:35:01.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40922024-11-27T18:35:01.759ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40932024-11-27T18:35:01.772ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 198.37816ms iteration = 2 status = {}
40942024-11-27T18:35:01.778ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
40952024-11-27T18:35:01.778ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40962024-11-27T18:35:01.780ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40972024-11-27T18:35:01.781ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40982024-11-27T18:35:01.781ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 207.514846ms iteration = 2 status = null
40992024-11-27T18:35:01.782ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41002024-11-27T18:35:01.782ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41012024-11-27T18:35:01.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41022024-11-27T18:35:01.783ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
41032024-11-27T18:35:01.783ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41042024-11-27T18:35:01.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41052024-11-27T18:35:01.784ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41062024-11-27T18:35:01.786ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41072024-11-27T18:35:01.786ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41082024-11-27T18:35:01.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41092024-11-27T18:35:01.789ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
41102024-11-27T18:35:01.789ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41112024-11-27T18:35:01.789ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1b1c8a7-4cbf-4c95-83eb-4f3dd803116e", "content-length": "26", "date": "Wed, 27 Nov 2024 18:35:01 GMT"} })
41122024-11-27T18:35:01.789ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41132024-11-27T18:35:01.790ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
41142024-11-27T18:35:01.815ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 240.602306ms iteration = 4 status = {"physical_disks_added":0}
41152024-11-27T18:35:01.849ZDEBGnexus (DpdClient): client request background_task = service_zone_nat_tracker body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
41162024-11-27T18:35:01.849ZDEBGnexus (DpdClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad4824e5-c3fd-450e-8bf5-0208cfc13b17", "content-length": "4", "date": "Wed, 27 Nov 2024 18:35:01 GMT"} })
41172024-11-27T18:35:01.851ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 276.985225ms iteration = 2 status = 2
41182024-11-27T18:35:01.874ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
41192024-11-27T18:35:01.900ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2147c90c-9109-44d0-90d2-2287ccc99443", "content-length": "691", "date": "Wed, 27 Nov 2024 18:35:01 GMT"} })
41202024-11-27T18:35:01.900ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
41212024-11-27T18:35:01.900ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
41222024-11-27T18:35:01.900ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
41232024-11-27T18:35:01.900ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a346a673-f63c-4d67-9df4-4ab11592222a", "content-length": "372", "date": "Wed, 27 Nov 2024 18:35:01 GMT"} })
41242024-11-27T18:35:01.900ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41252024-11-27T18:35:01.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41262024-11-27T18:35:01.901ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 327.310611ms iteration = 2 status = {}
41272024-11-27T18:35:01.917ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
41282024-11-27T18:35:01.917ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
41292024-11-27T18:35:01.922ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9fa338ac-c342-44f1-bc89-83fcd7dc1235", "date": "Wed, 27 Nov 2024 18:35:01 GMT"} })
41302024-11-27T18:35:01.922ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41312024-11-27T18:35:01.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41322024-11-27T18:35:01.925ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41332024-11-27T18:35:01.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41342024-11-27T18:35:01.928ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41352024-11-27T18:35:01.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41362024-11-27T18:35:01.933ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
41372024-11-27T18:35:01.933ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41382024-11-27T18:35:01.933ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c1b261c5-e351-4652-ae64-bda8abca5ed2", "date": "Wed, 27 Nov 2024 18:35:01 GMT"} })
41392024-11-27T18:35:01.934ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41402024-11-27T18:35:01.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41412024-11-27T18:35:01.935ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 360.813917ms iteration = 3 status = {}
41422024-11-27T18:35:01.937ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
41432024-11-27T18:35:01.937ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41442024-11-27T18:35:01.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41452024-11-27T18:35:02.006ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
41462024-11-27T18:35:02.007ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "359755cb-4848-4b36-8574-48d8de0f84b5", "content-length": "134", "date": "Wed, 27 Nov 2024 18:35:01 GMT"} })
41472024-11-27T18:35:02.007ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
41482024-11-27T18:35:02.007ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
41492024-11-27T18:35:02.007ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
41502024-11-27T18:35:02.007ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
41512024-11-27T18:35:02.007ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41522024-11-27T18:35:02.007ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41532024-11-27T18:35:02.007ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41542024-11-27T18:35:02.007ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
41552024-11-27T18:35:02.008ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41562024-11-27T18:35:02.008ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
41572024-11-27T18:35:02.008ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
41582024-11-27T18:35:02.008ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41592024-11-27T18:35:02.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41602024-11-27T18:35:02.022ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
41612024-11-27T18:35:02.023ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e22bee02-130c-496f-8f1b-b2a74d3b55ba", "content-length": "2", "date": "Wed, 27 Nov 2024 18:35:01 GMT"} })
41622024-11-27T18:35:02.023ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
41632024-11-27T18:35:02.023ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d651a74-79c9-4168-8b6d-4f7470950a75", "content-length": "52", "date": "Wed, 27 Nov 2024 18:35:01 GMT"} })
41642024-11-27T18:35:02.023ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
41652024-11-27T18:35:02.023ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
41662024-11-27T18:35:02.137ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "22f72c2e-8c9d-47e2-875b-25890a9fb1a0", "date": "Wed, 27 Nov 2024 18:35:01 GMT"} })
41672024-11-27T18:35:02.137ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
41682024-11-27T18:35:02.137ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
41692024-11-27T18:35:02.138ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b0f2456-8b23-45da-b42a-a28e699bafaa", "content-length": "682", "date": "Wed, 27 Nov 2024 18:35:01 GMT"} })
41702024-11-27T18:35:02.138ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41712024-11-27T18:35:02.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41722024-11-27T18:35:02.149ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41732024-11-27T18:35:02.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41742024-11-27T18:35:02.153ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41752024-11-27T18:35:02.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41762024-11-27T18:35:02.155ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41772024-11-27T18:35:02.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41782024-11-27T18:35:02.168ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 593.963404ms iteration = 2 status = {}
41792024-11-27T18:35:08.740ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1064 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 334766d3-f011-4098-8ec3-82b1a075e4ca response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
41802024-11-27T18:35:11.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 5 reason = Timeout
41812024-11-27T18:35:11.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 5 reason = Timeout
41822024-11-27T18:35:11.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41832024-11-27T18:35:11.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41842024-11-27T18:35:11.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41852024-11-27T18:35:11.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41862024-11-27T18:35:11.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41872024-11-27T18:35:11.577ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41882024-11-27T18:35:11.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41892024-11-27T18:35:11.578ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.539907ms iteration = 5 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41902024-11-27T18:35:11.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41912024-11-27T18:35:11.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41922024-11-27T18:35:11.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41932024-11-27T18:35:11.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41942024-11-27T18:35:11.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41952024-11-27T18:35:11.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41962024-11-27T18:35:11.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
41972024-11-27T18:35:11.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41982024-11-27T18:35:11.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41992024-11-27T18:35:11.608ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
42002024-11-27T18:35:11.608ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 34.143356ms iteration = 5 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
42012024-11-27T18:35:18.740ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 989 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 0286217e-3ec3-4b74-b201-198ef73d49a7 response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
42022024-11-27T18:35:21.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 6 reason = Timeout
42032024-11-27T18:35:21.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 6 reason = Timeout
42042024-11-27T18:35:21.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42052024-11-27T18:35:21.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42062024-11-27T18:35:21.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42072024-11-27T18:35:21.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42082024-11-27T18:35:21.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42092024-11-27T18:35:21.577ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42102024-11-27T18:35:21.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42112024-11-27T18:35:21.578ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.71292ms iteration = 6 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42122024-11-27T18:35:21.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42132024-11-27T18:35:21.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42142024-11-27T18:35:21.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42152024-11-27T18:35:21.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42162024-11-27T18:35:21.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42172024-11-27T18:35:21.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42182024-11-27T18:35:21.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
42192024-11-27T18:35:21.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42202024-11-27T18:35:21.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42212024-11-27T18:35:21.597ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
42222024-11-27T18:35:21.597ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.598689ms iteration = 6 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
42232024-11-27T18:35:28.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49565 req_id = aa04c838-58a6-463e-ba8e-afab0f4896fe roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
42242024-11-27T18:35:28.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49565 req_id = aa04c838-58a6-463e-ba8e-afab0f4896fe resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
42252024-11-27T18:35:28.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3301 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49565 req_id = aa04c838-58a6-463e-ba8e-afab0f4896fe response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
42262024-11-27T18:35:28.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49565 req_id = 92ad58bb-f780-4acc-9f21-dd216cec589f roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmM2Y3ZjIzNC05MzhmLTRlYjQtODRjZC05YWNkNzNlNTk5MjQifX0%3D
42272024-11-27T18:35:28.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49565 req_id = 92ad58bb-f780-4acc-9f21-dd216cec589f resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmM2Y3ZjIzNC05MzhmLTRlYjQtODRjZC05YWNkNzNlNTk5MjQifX0%3D
42282024-11-27T18:35:28.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2887 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49565 req_id = 92ad58bb-f780-4acc-9f21-dd216cec589f response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmM2Y3ZjIzNC05MzhmLTRlYjQtODRjZC05YWNkNzNlNTk5MjQifX0%3D
42292024-11-27T18:35:28.741ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1116 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 7659103b-296c-4aaf-9458-9e6629792880 response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
42302024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 3 reason = Timeout
42312024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
42322024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
42332024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 5 reason = Timeout
42342024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42352024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 2 reason = Timeout
42362024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 2 reason = Timeout
42372024-11-27T18:35:31.574ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-27 18:25:31.574274968 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
42382024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
42392024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
42402024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 3 reason = Timeout
42412024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 3 reason = Timeout
42422024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
42432024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42442024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 3 reason = Timeout
42452024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 3 reason = Timeout
42462024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 3 reason = Timeout
42472024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
42482024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
42492024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 3 reason = Timeout
42502024-11-27T18:35:31.574ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 4ce244bc-1034-4855-877d-76a08bc15b71
42512024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 3 reason = Timeout
42522024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 4 reason = Timeout
42532024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
42542024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.99\u{b5}s iteration = 3 status = {"enabled":false,"target_id":"4ce244bc-1034-4855-877d-76a08bc15b71"}
42552024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42562024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 3 reason = Timeout
42572024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 3 reason = Timeout
42582024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42592024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
42602024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42612024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
42622024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42632024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
42642024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 2 reason = Timeout
42652024-11-27T18:35:31.574ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
42662024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
42672024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 4 reason = Timeout
42682024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 3 reason = Timeout
42692024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42702024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 3 reason = Timeout
42712024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 3 reason = Timeout
42722024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42732024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
42742024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 2 reason = Timeout
42752024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 2 reason = Timeout
42762024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
42772024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
42782024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Timeout
42792024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 3 reason = Timeout
42802024-11-27T18:35:31.574ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
42812024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42822024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42832024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 7 reason = Timeout
42842024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
42852024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42862024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42872024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 7 reason = Timeout
42882024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42892024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
42902024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
42912024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42922024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
42932024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42942024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
42952024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
42962024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
42972024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
42982024-11-27T18:35:31.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42992024-11-27T18:35:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43002024-11-27T18:35:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43012024-11-27T18:35:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
43022024-11-27T18:35:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43032024-11-27T18:35:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
43042024-11-27T18:35:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
43052024-11-27T18:35:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
43062024-11-27T18:35:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43072024-11-27T18:35:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43082024-11-27T18:35:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
43092024-11-27T18:35:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43102024-11-27T18:35:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43112024-11-27T18:35:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43122024-11-27T18:35:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
43132024-11-27T18:35:31.575ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("923a7051-0539-4413-bab4-c2b0d3395fe2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2165, tv_nsec: 573469499 } })
43142024-11-27T18:35:31.575ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f378a24-7578-4d72-8454-f489a3e51ffb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e203eafc-5cbd-4249-8d8a-770878ed4d6d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 2165, tv_nsec: 573503760 } })
43152024-11-27T18:35:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43162024-11-27T18:35:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43172024-11-27T18:35:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43182024-11-27T18:35:31.575ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
43192024-11-27T18:35:31.575ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.353481ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
43202024-11-27T18:35:31.575ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
43212024-11-27T18:35:31.575ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.710795ms iteration = 3 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
43222024-11-27T18:35:31.578ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43232024-11-27T18:35:31.578ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.466526ms iteration = 2 status = {"errors":[],"found_port_ok":[]}
43242024-11-27T18:35:31.579ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.773971ms iteration = 3 status = {"errors":[],"garbage_collect_requested":[]}
43252024-11-27T18:35:31.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43262024-11-27T18:35:31.580ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43272024-11-27T18:35:31.580ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.796496ms iteration = 3 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
43282024-11-27T18:35:31.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43292024-11-27T18:35:31.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43302024-11-27T18:35:31.581ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43312024-11-27T18:35:31.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43322024-11-27T18:35:31.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43332024-11-27T18:35:31.582ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43342024-11-27T18:35:31.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43352024-11-27T18:35:31.583ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43362024-11-27T18:35:31.583ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
43372024-11-27T18:35:31.583ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43382024-11-27T18:35:31.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43392024-11-27T18:35:31.584ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43402024-11-27T18:35:31.584ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-27 18:25:31.574274968 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
43412024-11-27T18:35:31.584ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 10.036549ms iteration = 2 status = {"expiration":"2024-11-27T18:25:31.574274968Z","pruned":[]}
43422024-11-27T18:35:31.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43432024-11-27T18:35:31.586ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2165, tv_nsec: 584437932 } })
43442024-11-27T18:35:31.586ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
43452024-11-27T18:35:31.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
43462024-11-27T18:35:31.587ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
43472024-11-27T18:35:31.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
43482024-11-27T18:35:31.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43492024-11-27T18:35:31.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43502024-11-27T18:35:31.589ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43512024-11-27T18:35:31.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43522024-11-27T18:35:31.589ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2165, tv_nsec: 587565628 } })
43532024-11-27T18:35:31.589ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
43542024-11-27T18:35:31.590ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
43552024-11-27T18:35:31.590ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43562024-11-27T18:35:31.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
43572024-11-27T18:35:31.590ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43582024-11-27T18:35:31.591ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43592024-11-27T18:35:31.592ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43602024-11-27T18:35:31.592ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43612024-11-27T18:35:31.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43622024-11-27T18:35:31.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
43632024-11-27T18:35:31.594ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43642024-11-27T18:35:31.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
43652024-11-27T18:35:31.594ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43662024-11-27T18:35:31.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43672024-11-27T18:35:31.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43682024-11-27T18:35:31.594ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
43692024-11-27T18:35:31.594ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43702024-11-27T18:35:31.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43712024-11-27T18:35:31.595ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43722024-11-27T18:35:31.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43732024-11-27T18:35:31.597ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43742024-11-27T18:35:31.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43752024-11-27T18:35:31.598ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43762024-11-27T18:35:31.602ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
43772024-11-27T18:35:31.604ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
43782024-11-27T18:35:31.604ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
43792024-11-27T18:35:31.604ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
43802024-11-27T18:35:31.604ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43812024-11-27T18:35:31.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43822024-11-27T18:35:31.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43832024-11-27T18:35:31.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43842024-11-27T18:35:31.605ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43852024-11-27T18:35:31.606ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43862024-11-27T18:35:31.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43872024-11-27T18:35:31.607ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43882024-11-27T18:35:31.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43892024-11-27T18:35:31.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43902024-11-27T18:35:31.610ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43912024-11-27T18:35:31.610ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43922024-11-27T18:35:31.610ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43932024-11-27T18:35:31.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43942024-11-27T18:35:31.611ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43952024-11-27T18:35:31.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43962024-11-27T18:35:31.613ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43972024-11-27T18:35:31.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43982024-11-27T18:35:31.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
43992024-11-27T18:35:31.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
44002024-11-27T18:35:31.616ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44012024-11-27T18:35:31.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44022024-11-27T18:35:31.618ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 43.739109ms iteration = 3 status = {"errors":[],"records_set_to_done":[]}
44032024-11-27T18:35:31.622ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44042024-11-27T18:35:31.625ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
44052024-11-27T18:35:31.625ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44062024-11-27T18:35:31.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44072024-11-27T18:35:31.636ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44082024-11-27T18:35:31.636ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44092024-11-27T18:35:31.636ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
44102024-11-27T18:35:31.636ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
44112024-11-27T18:35:31.636ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44122024-11-27T18:35:31.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44132024-11-27T18:35:31.638ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
44142024-11-27T18:35:31.638ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44152024-11-27T18:35:31.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
44162024-11-27T18:35:31.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44172024-11-27T18:35:31.639ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 65.036084ms iteration = 5 status = {"physical_disks_added":0}
44182024-11-27T18:35:31.639ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
44192024-11-27T18:35:31.639ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44202024-11-27T18:35:31.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44212024-11-27T18:35:31.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
44222024-11-27T18:35:31.640ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44232024-11-27T18:35:31.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44242024-11-27T18:35:31.641ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44252024-11-27T18:35:31.642ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 67.878526ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
44262024-11-27T18:35:31.642ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44272024-11-27T18:35:31.642ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 68.420804ms iteration = 3 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
44282024-11-27T18:35:31.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44292024-11-27T18:35:31.643ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.430934ms iteration = 7 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44302024-11-27T18:35:31.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
44312024-11-27T18:35:31.644ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44322024-11-27T18:35:31.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44332024-11-27T18:35:31.645ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
44342024-11-27T18:35:31.645ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 70.637617ms iteration = 7 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
44352024-11-27T18:35:31.645ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
44362024-11-27T18:35:31.645ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
44372024-11-27T18:35:31.645ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 71.151875ms iteration = 2 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
44382024-11-27T18:35:31.646ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 72.390873ms iteration = 3 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
44392024-11-27T18:35:31.646ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44402024-11-27T18:35:31.647ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2165, tv_nsec: 645265274 } })
44412024-11-27T18:35:31.647ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44422024-11-27T18:35:31.647ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
44432024-11-27T18:35:31.647ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44442024-11-27T18:35:31.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44452024-11-27T18:35:31.647ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
44462024-11-27T18:35:31.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44472024-11-27T18:35:31.648ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44482024-11-27T18:35:31.648ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
44492024-11-27T18:35:31.648ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
44502024-11-27T18:35:31.648ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-27 18:34:43.283070 UTC dns_group = internal generation = 1
44512024-11-27T18:35:31.648ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 74.445254ms iteration = 3 status = {"generation":1}
44522024-11-27T18:35:31.649ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
44532024-11-27T18:35:31.649ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
44542024-11-27T18:35:31.649ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 75.367597ms iteration = 2 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
44552024-11-27T18:35:31.651ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
44562024-11-27T18:35:31.651ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44572024-11-27T18:35:31.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44582024-11-27T18:35:31.654ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
44592024-11-27T18:35:31.654ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
44602024-11-27T18:35:31.654ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
44612024-11-27T18:35:31.654ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44622024-11-27T18:35:31.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44632024-11-27T18:35:31.656ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44642024-11-27T18:35:31.660ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44652024-11-27T18:35:31.660ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44662024-11-27T18:35:31.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44672024-11-27T18:35:31.660ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44682024-11-27T18:35:31.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44692024-11-27T18:35:31.662ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
44702024-11-27T18:35:31.662ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 0 version = 2
44712024-11-27T18:35:31.662ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44722024-11-27T18:35:31.663ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44732024-11-27T18:35:31.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44742024-11-27T18:35:31.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44752024-11-27T18:35:31.664ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
44762024-11-27T18:35:31.664ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 89.640118ms iteration = 3 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
44772024-11-27T18:35:31.664ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
44782024-11-27T18:35:31.664ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 90.305669ms iteration = 2 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
44792024-11-27T18:35:31.664ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44802024-11-27T18:35:31.665ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44812024-11-27T18:35:31.668ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
44822024-11-27T18:35:31.668ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44832024-11-27T18:35:31.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44842024-11-27T18:35:31.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44852024-11-27T18:35:31.669ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44862024-11-27T18:35:31.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44872024-11-27T18:35:31.670ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 95.967062ms iteration = 3 status = 0
44882024-11-27T18:35:31.671ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 1 version = 2
44892024-11-27T18:35:31.671ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
44902024-11-27T18:35:31.671ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-27 18:34:44.388958 UTC dns_group = external generation = 2
44912024-11-27T18:35:31.671ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 96.908367ms iteration = 3 status = {"generation":2}
44922024-11-27T18:35:31.683ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44932024-11-27T18:35:31.683ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
44942024-11-27T18:35:31.683ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 109.452862ms iteration = 3 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
44952024-11-27T18:35:31.686ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
44962024-11-27T18:35:31.689ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-27T18:34:28.564237Z, time_modified: 2024-11-27T18:34:28.564237Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
44972024-11-27T18:35:31.689ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 114.908293ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]}},"default_endpoint":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
44982024-11-27T18:35:31.697ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
44992024-11-27T18:35:31.713ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45002024-11-27T18:35:31.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45012024-11-27T18:35:31.719ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
45022024-11-27T18:35:31.719ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45032024-11-27T18:35:31.719ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1cc833b9-e5a1-4b30-a32a-5814b3dba2b2", "content-length": "26", "date": "Wed, 27 Nov 2024 18:35:31 GMT"} })
45042024-11-27T18:35:31.719ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45052024-11-27T18:35:31.720ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45062024-11-27T18:35:31.729ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
45072024-11-27T18:35:31.729ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45082024-11-27T18:35:31.730ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "73fa36b3-9508-47e3-9402-0b14915d01d3", "content-length": "26", "date": "Wed, 27 Nov 2024 18:35:31 GMT"} })
45092024-11-27T18:35:31.730ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45102024-11-27T18:35:31.731ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45112024-11-27T18:35:31.810ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45122024-11-27T18:35:31.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45132024-11-27T18:35:31.812ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45142024-11-27T18:35:31.815ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45152024-11-27T18:35:31.815ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45162024-11-27T18:35:31.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45172024-11-27T18:35:31.816ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45182024-11-27T18:35:31.818ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45192024-11-27T18:35:31.818ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45202024-11-27T18:35:31.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45212024-11-27T18:35:31.849ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
45222024-11-27T18:35:31.850ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b4144bb8-ea0b-4c52-867d-147dc4ef0a77", "date": "Wed, 27 Nov 2024 18:35:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
45232024-11-27T18:35:31.850ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
45242024-11-27T18:35:31.852ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "5ecb4079-a01c-476d-9b44-bd191f47abbc", "date": "Wed, 27 Nov 2024 18:35:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
45252024-11-27T18:35:31.852ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
45262024-11-27T18:35:31.853ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
45272024-11-27T18:35:31.853ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 278.850752ms iteration = 4 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
45282024-11-27T18:35:31.900ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
45292024-11-27T18:35:31.900ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45302024-11-27T18:35:31.901ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f696c816-6df2-4889-b13d-5be85185323c", "content-length": "26", "date": "Wed, 27 Nov 2024 18:35:31 GMT"} })
45312024-11-27T18:35:31.901ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45322024-11-27T18:35:31.903ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
45332024-11-27T18:35:31.934ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
45342024-11-27T18:35:31.934ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45352024-11-27T18:35:31.934ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0851b44d-a5a0-4b58-99dd-5e2d1d896daa", "content-length": "372", "date": "Wed, 27 Nov 2024 18:35:31 GMT"} })
45362024-11-27T18:35:31.934ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45372024-11-27T18:35:31.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45382024-11-27T18:35:31.966ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 391.99668ms iteration = 3 status = {}
45392024-11-27T18:35:31.979ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
45402024-11-27T18:35:31.992ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
45412024-11-27T18:35:31.992ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
45422024-11-27T18:35:32.020ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
45432024-11-27T18:35:32.025ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
45442024-11-27T18:35:32.026ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "843ab5e6-c128-4256-9b84-6c887f86950f", "content-length": "1", "date": "Wed, 27 Nov 2024 18:35:31 GMT"} })
45452024-11-27T18:35:32.027ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
45462024-11-27T18:35:32.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
45472024-11-27T18:35:32.030ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 456.454815ms iteration = 3 status = null
45482024-11-27T18:35:32.088ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
45492024-11-27T18:35:32.089ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "78c9b63d-b8cc-4897-80c8-4fbf74743426", "date": "Wed, 27 Nov 2024 18:35:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
45502024-11-27T18:35:32.089ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
45512024-11-27T18:35:32.090ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "b6928be2-4bf2-47fc-b769-799e0e6aaf5d", "date": "Wed, 27 Nov 2024 18:35:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
45522024-11-27T18:35:32.090ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
45532024-11-27T18:35:32.092ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "c624270b-10dc-40c9-a78c-e455aef7b1b9", "date": "Wed, 27 Nov 2024 18:35:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
45542024-11-27T18:35:32.092ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
45552024-11-27T18:35:32.093ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
45562024-11-27T18:35:32.094ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 519.53892ms iteration = 4 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
45572024-11-27T18:35:32.100ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0b8c573-1c1b-4350-b401-ba48c454cef9", "content-length": "691", "date": "Wed, 27 Nov 2024 18:35:31 GMT"} })
45582024-11-27T18:35:32.100ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
45592024-11-27T18:35:32.100ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
45602024-11-27T18:35:32.100ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
45612024-11-27T18:35:32.101ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bcf273c6-1209-4620-8307-22c28b64a675", "date": "Wed, 27 Nov 2024 18:35:32 GMT"} })
45622024-11-27T18:35:32.101ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45632024-11-27T18:35:32.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45642024-11-27T18:35:32.102ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 528.022256ms iteration = 3 status = {}
45652024-11-27T18:35:32.104ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45662024-11-27T18:35:32.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45672024-11-27T18:35:32.107ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45682024-11-27T18:35:32.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45692024-11-27T18:35:32.111ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
45702024-11-27T18:35:32.111ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45712024-11-27T18:35:32.111ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2665e138-29d1-4c90-a7ef-f328703d8d9a", "date": "Wed, 27 Nov 2024 18:35:31 GMT"} })
45722024-11-27T18:35:32.114ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 539.78256ms iteration = 4 status = {}
45732024-11-27T18:35:32.138ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45742024-11-27T18:35:32.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45752024-11-27T18:35:32.237ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
45762024-11-27T18:35:32.238ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45772024-11-27T18:35:32.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45782024-11-27T18:35:32.247ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
45792024-11-27T18:35:32.248ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b05d73d5-aac9-466f-b776-9565b7852331", "content-length": "134", "date": "Wed, 27 Nov 2024 18:35:31 GMT"} })
45802024-11-27T18:35:32.248ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
45812024-11-27T18:35:32.248ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
45822024-11-27T18:35:32.248ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
45832024-11-27T18:35:32.248ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
45842024-11-27T18:35:32.248ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45852024-11-27T18:35:32.248ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45862024-11-27T18:35:32.248ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45872024-11-27T18:35:32.248ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
45882024-11-27T18:35:32.248ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45892024-11-27T18:35:32.248ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
45902024-11-27T18:35:32.248ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
45912024-11-27T18:35:32.248ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45922024-11-27T18:35:32.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45932024-11-27T18:35:32.251ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
45942024-11-27T18:35:32.251ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3378331-9658-47d9-92d1-750fb1ec947e", "content-length": "2", "date": "Wed, 27 Nov 2024 18:35:31 GMT"} })
45952024-11-27T18:35:32.251ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
45962024-11-27T18:35:32.251ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5461ef2c-e62b-47ea-aeac-3a04aaf1db71", "content-length": "52", "date": "Wed, 27 Nov 2024 18:35:31 GMT"} })
45972024-11-27T18:35:32.251ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
45982024-11-27T18:35:32.251ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
45992024-11-27T18:35:32.342ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e5b08931-b9df-4b4d-89b7-da2ac85f1b08", "date": "Wed, 27 Nov 2024 18:35:31 GMT"} })
46002024-11-27T18:35:32.342ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
46012024-11-27T18:35:32.342ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
46022024-11-27T18:35:32.342ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ae925fe-4d7a-4c5e-b844-52da48d8974b", "content-length": "682", "date": "Wed, 27 Nov 2024 18:35:31 GMT"} })
46032024-11-27T18:35:32.342ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46042024-11-27T18:35:32.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46052024-11-27T18:35:32.351ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46062024-11-27T18:35:32.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46072024-11-27T18:35:32.454ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46082024-11-27T18:35:32.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46092024-11-27T18:35:32.469ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46102024-11-27T18:35:32.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46112024-11-27T18:35:32.476ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 901.709265ms iteration = 3 status = {}
46122024-11-27T18:35:38.741ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1373 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 3cec7ba3-0342-4931-bece-f50f08e84f57 response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
46132024-11-27T18:35:41.573ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 8 reason = Timeout
46142024-11-27T18:35:41.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 8 reason = Timeout
46152024-11-27T18:35:41.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46162024-11-27T18:35:41.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46172024-11-27T18:35:41.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46182024-11-27T18:35:41.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46192024-11-27T18:35:41.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46202024-11-27T18:35:41.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46212024-11-27T18:35:41.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46222024-11-27T18:35:41.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46232024-11-27T18:35:41.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46242024-11-27T18:35:41.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46252024-11-27T18:35:41.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46262024-11-27T18:35:41.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
46272024-11-27T18:35:41.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46282024-11-27T18:35:41.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46292024-11-27T18:35:41.597ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
46302024-11-27T18:35:41.597ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.570409ms iteration = 8 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
46312024-11-27T18:35:41.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46322024-11-27T18:35:41.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46332024-11-27T18:35:41.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.083495ms iteration = 8 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46342024-11-27T18:35:48.281ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:60666
46352024-11-27T18:35:48.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60666 req_id = 8920e6f1-c6b5-4847-9fbf-717f4b3bedea roles = RoleSet { roles: {} } uri = /metrics/producers
46362024-11-27T18:35:48.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60666 req_id = 8920e6f1-c6b5-4847-9fbf-717f4b3bedea resource = Database result = Ok(()) uri = /metrics/producers
46372024-11-27T18:35:48.290ZINFOnexus: assigned collector to new producer collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:76 producer_id = d7cc4ac1-6d92-4a20-8b63-97d7517b1cd5
46382024-11-27T18:35:48.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8886 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60666 req_id = 8920e6f1-c6b5-4847-9fbf-717f4b3bedea response_code = 201 uri = /metrics/producers
46392024-11-27T18:35:48.741ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 991 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 2573546d-b5fd-4fd6-822d-22816275c0e5 response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
46402024-11-27T18:35:51.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 9 reason = Timeout
46412024-11-27T18:35:51.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 9 reason = Timeout
46422024-11-27T18:35:51.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46432024-11-27T18:35:51.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46442024-11-27T18:35:51.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46452024-11-27T18:35:51.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46462024-11-27T18:35:51.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46472024-11-27T18:35:51.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46482024-11-27T18:35:51.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46492024-11-27T18:35:51.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46502024-11-27T18:35:51.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46512024-11-27T18:35:51.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46522024-11-27T18:35:51.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46532024-11-27T18:35:51.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
46542024-11-27T18:35:51.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46552024-11-27T18:35:51.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46562024-11-27T18:35:51.595ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
46572024-11-27T18:35:51.595ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.153914ms iteration = 9 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
46582024-11-27T18:35:51.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46592024-11-27T18:35:51.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46602024-11-27T18:35:51.633ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.624029ms iteration = 9 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46612024-11-27T18:35:58.742ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1120 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 6e535db6-fc87-4028-8cd4-44c59bdc448c response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
46622024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
46632024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
46642024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 4 reason = Timeout
46652024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46662024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46672024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
46682024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
46692024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 4 reason = Timeout
46702024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
46712024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
46722024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
46732024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46742024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
46752024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
46762024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
46772024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46782024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
46792024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
46802024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
46812024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
46822024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46832024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
46842024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
46852024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
46862024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
46872024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46882024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
46892024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46902024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
46912024-11-27T18:36:01.574ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
46922024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46932024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Timeout
46942024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
46952024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46962024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46972024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46982024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46992024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47002024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47012024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
47022024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47032024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
47042024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
47052024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
47062024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
47072024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47082024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47092024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
47102024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47112024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
47122024-11-27T18:36:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47132024-11-27T18:36:01.577ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47142024-11-27T18:36:01.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47152024-11-27T18:36:01.577ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47162024-11-27T18:36:01.577ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.496912ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
47172024-11-27T18:36:01.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47182024-11-27T18:36:01.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
47192024-11-27T18:36:01.579ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47202024-11-27T18:36:01.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47212024-11-27T18:36:01.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47222024-11-27T18:36:01.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47232024-11-27T18:36:01.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47242024-11-27T18:36:01.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47252024-11-27T18:36:01.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47262024-11-27T18:36:01.582ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2195, tv_nsec: 581101002 } })
47272024-11-27T18:36:01.583ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.011204ms iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
47282024-11-27T18:36:01.583ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
47292024-11-27T18:36:01.589ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2195, tv_nsec: 587842042 } })
47302024-11-27T18:36:01.590ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
47312024-11-27T18:36:01.590ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47322024-11-27T18:36:01.590ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47332024-11-27T18:36:01.591ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47342024-11-27T18:36:01.592ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47352024-11-27T18:36:01.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
47362024-11-27T18:36:01.592ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47372024-11-27T18:36:01.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47382024-11-27T18:36:01.593ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47392024-11-27T18:36:01.593ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47402024-11-27T18:36:01.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47412024-11-27T18:36:01.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
47422024-11-27T18:36:01.594ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
47432024-11-27T18:36:01.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
47442024-11-27T18:36:01.595ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47452024-11-27T18:36:01.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47462024-11-27T18:36:01.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
47472024-11-27T18:36:01.595ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47482024-11-27T18:36:01.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47492024-11-27T18:36:01.597ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2195, tv_nsec: 595550626 } })
47502024-11-27T18:36:01.597ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47512024-11-27T18:36:01.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47522024-11-27T18:36:01.598ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47532024-11-27T18:36:01.598ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
47542024-11-27T18:36:01.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47552024-11-27T18:36:01.599ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47562024-11-27T18:36:01.599ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47572024-11-27T18:36:01.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47582024-11-27T18:36:01.601ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47592024-11-27T18:36:01.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47602024-11-27T18:36:01.601ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47612024-11-27T18:36:01.601ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47622024-11-27T18:36:01.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47632024-11-27T18:36:01.603ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47642024-11-27T18:36:01.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
47652024-11-27T18:36:01.605ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47662024-11-27T18:36:01.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47672024-11-27T18:36:01.615ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
47682024-11-27T18:36:01.615ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 40.778155ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
47692024-11-27T18:36:01.621ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 47.531165ms iteration = 4 status = {"errors":[],"records_set_to_done":[]}
47702024-11-27T18:36:01.622ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
47712024-11-27T18:36:01.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
47722024-11-27T18:36:01.624ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 50.62573ms iteration = 4 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
47732024-11-27T18:36:01.633ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47742024-11-27T18:36:01.633ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
47752024-11-27T18:36:01.633ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47762024-11-27T18:36:01.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47772024-11-27T18:36:01.636ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47782024-11-27T18:36:01.636ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
47792024-11-27T18:36:01.636ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47802024-11-27T18:36:01.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47812024-11-27T18:36:01.638ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.121431ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47822024-11-27T18:36:01.639ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 65.100554ms iteration = 4 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
47832024-11-27T18:36:01.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47842024-11-27T18:36:01.640ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
47852024-11-27T18:36:01.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
47862024-11-27T18:36:01.642ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
47872024-11-27T18:36:01.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47882024-11-27T18:36:01.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47892024-11-27T18:36:01.642ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 68.427445ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
47902024-11-27T18:36:01.656ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
47912024-11-27T18:36:01.656ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 82.383591ms iteration = 10 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
47922024-11-27T18:36:01.676ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
47932024-11-27T18:36:01.676ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47942024-11-27T18:36:01.676ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "003017e2-aec9-49a2-a985-08643155cbca", "content-length": "26", "date": "Wed, 27 Nov 2024 18:36:01 GMT"} })
47952024-11-27T18:36:01.676ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47962024-11-27T18:36:01.678ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47972024-11-27T18:36:01.683ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47982024-11-27T18:36:01.683ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
47992024-11-27T18:36:01.683ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 109.012396ms iteration = 4 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
48002024-11-27T18:36:01.686ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
48012024-11-27T18:36:01.686ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48022024-11-27T18:36:01.687ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "29755efd-325a-4a38-80b9-0fd3036960d6", "content-length": "26", "date": "Wed, 27 Nov 2024 18:36:01 GMT"} })
48032024-11-27T18:36:01.687ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48042024-11-27T18:36:01.688ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
48052024-11-27T18:36:01.705ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48062024-11-27T18:36:01.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48072024-11-27T18:36:01.707ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
48082024-11-27T18:36:01.707ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48092024-11-27T18:36:01.707ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cafd11e7-3bb8-4695-a35a-f2492a4cdfb1", "content-length": "26", "date": "Wed, 27 Nov 2024 18:36:01 GMT"} })
48102024-11-27T18:36:01.707ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48112024-11-27T18:36:01.708ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
48122024-11-27T18:36:01.729ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48132024-11-27T18:36:01.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48142024-11-27T18:36:01.786ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
48152024-11-27T18:36:01.786ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48162024-11-27T18:36:01.787ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9bb9b569-eceb-4c9d-bf88-bd684289144b", "content-length": "372", "date": "Wed, 27 Nov 2024 18:36:01 GMT"} })
48172024-11-27T18:36:01.787ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48182024-11-27T18:36:01.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48192024-11-27T18:36:01.789ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48202024-11-27T18:36:01.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48212024-11-27T18:36:01.791ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48222024-11-27T18:36:01.793ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
48232024-11-27T18:36:01.793ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48242024-11-27T18:36:01.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48252024-11-27T18:36:01.795ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 221.687625ms iteration = 4 status = 0
48262024-11-27T18:36:01.818ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 244.621195ms iteration = 6 status = {"physical_disks_added":0}
48272024-11-27T18:36:01.821ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48282024-11-27T18:36:01.823ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48292024-11-27T18:36:01.823ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48302024-11-27T18:36:01.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48312024-11-27T18:36:01.825ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48322024-11-27T18:36:01.827ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48332024-11-27T18:36:01.827ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48342024-11-27T18:36:01.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48352024-11-27T18:36:01.832ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
48362024-11-27T18:36:01.832ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
48372024-11-27T18:36:01.832ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "71e1256a-a1fa-40ca-89d2-f62d335df9eb", "date": "Wed, 27 Nov 2024 18:36:01 GMT"} })
48382024-11-27T18:36:01.832ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48392024-11-27T18:36:01.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48402024-11-27T18:36:01.834ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48412024-11-27T18:36:01.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48422024-11-27T18:36:01.837ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48432024-11-27T18:36:01.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48442024-11-27T18:36:01.840ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
48452024-11-27T18:36:01.840ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48462024-11-27T18:36:01.840ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a80f090d-a8fd-41a5-b3ed-d6d73062d77d", "date": "Wed, 27 Nov 2024 18:36:01 GMT"} })
48472024-11-27T18:36:01.842ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 268.218015ms iteration = 5 status = {}
48482024-11-27T18:36:01.895ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
48492024-11-27T18:36:01.895ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7499359a-ac43-4913-bf50-334657caaa9e", "content-length": "1", "date": "Wed, 27 Nov 2024 18:36:01 GMT"} })
48502024-11-27T18:36:01.896ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48512024-11-27T18:36:01.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
48522024-11-27T18:36:01.899ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 325.030628ms iteration = 4 status = null
48532024-11-27T18:36:01.903ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 329.081367ms iteration = 4 status = {}
48542024-11-27T18:36:01.952ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
48552024-11-27T18:36:01.960ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48562024-11-27T18:36:01.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48572024-11-27T18:36:01.962ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
48582024-11-27T18:36:01.962ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48592024-11-27T18:36:01.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48602024-11-27T18:36:01.973ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
48612024-11-27T18:36:01.974ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee34d32a-e49a-4dd1-badd-4f9c3bd199f2", "content-length": "134", "date": "Wed, 27 Nov 2024 18:36:01 GMT"} })
48622024-11-27T18:36:01.974ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
48632024-11-27T18:36:01.974ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
48642024-11-27T18:36:01.975ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
48652024-11-27T18:36:01.975ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
48662024-11-27T18:36:01.975ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48672024-11-27T18:36:01.975ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48682024-11-27T18:36:01.975ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48692024-11-27T18:36:01.975ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
48702024-11-27T18:36:01.975ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48712024-11-27T18:36:01.975ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
48722024-11-27T18:36:01.975ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
48732024-11-27T18:36:01.975ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48742024-11-27T18:36:01.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48752024-11-27T18:36:01.978ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
48762024-11-27T18:36:01.978ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "43e39df7-c4c3-4b30-9e5f-4e0130916d81", "content-length": "2", "date": "Wed, 27 Nov 2024 18:36:01 GMT"} })
48772024-11-27T18:36:01.978ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
48782024-11-27T18:36:01.978ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1305b8d-79df-4437-ac12-e4c8e5ca2c2f", "content-length": "52", "date": "Wed, 27 Nov 2024 18:36:01 GMT"} })
48792024-11-27T18:36:01.978ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
48802024-11-27T18:36:01.978ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
48812024-11-27T18:36:02.064ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "51295800-4f34-4867-afa9-39823c4cc46a", "content-length": "691", "date": "Wed, 27 Nov 2024 18:36:02 GMT"} })
48822024-11-27T18:36:02.064ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
48832024-11-27T18:36:02.064ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
48842024-11-27T18:36:02.064ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
48852024-11-27T18:36:02.066ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 492.000002ms iteration = 4 status = {}
48862024-11-27T18:36:02.158ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "71fb0faa-53c3-4baf-9510-8fce73d62e4a", "date": "Wed, 27 Nov 2024 18:36:01 GMT"} })
48872024-11-27T18:36:02.158ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
48882024-11-27T18:36:02.158ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
48892024-11-27T18:36:02.158ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b28a589-ff69-42e4-bb5c-84a8dcd33550", "content-length": "682", "date": "Wed, 27 Nov 2024 18:36:02 GMT"} })
48902024-11-27T18:36:02.158ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48912024-11-27T18:36:02.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48922024-11-27T18:36:02.163ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48932024-11-27T18:36:02.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48942024-11-27T18:36:02.276ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48952024-11-27T18:36:02.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48962024-11-27T18:36:02.278ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48972024-11-27T18:36:02.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48982024-11-27T18:36:02.286ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 712.086224ms iteration = 4 status = {}
48992024-11-27T18:36:08.741ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1073 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 75167409-c6a5-44aa-80a2-0798af73c7e7 response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
49002024-11-27T18:36:11.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
49012024-11-27T18:36:11.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
49022024-11-27T18:36:11.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49032024-11-27T18:36:11.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49042024-11-27T18:36:11.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49052024-11-27T18:36:11.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49062024-11-27T18:36:11.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49072024-11-27T18:36:11.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49082024-11-27T18:36:11.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49092024-11-27T18:36:11.578ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.326584ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49102024-11-27T18:36:11.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49112024-11-27T18:36:11.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49122024-11-27T18:36:11.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49132024-11-27T18:36:11.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49142024-11-27T18:36:11.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49152024-11-27T18:36:11.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49162024-11-27T18:36:11.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
49172024-11-27T18:36:11.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49182024-11-27T18:36:11.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49192024-11-27T18:36:11.603ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
49202024-11-27T18:36:11.603ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.955979ms iteration = 11 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
49212024-11-27T18:36:13.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49565 req_id = a95c7e1e-b3e7-41ea-bb48-91ae6d4059ad roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
49222024-11-27T18:36:13.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49565 req_id = a95c7e1e-b3e7-41ea-bb48-91ae6d4059ad resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
49232024-11-27T18:36:13.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4006 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49565 req_id = a95c7e1e-b3e7-41ea-bb48-91ae6d4059ad response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
49242024-11-27T18:36:13.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49565 req_id = 8072d32a-1154-4334-9594-be66e38e6548 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
49252024-11-27T18:36:13.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49565 req_id = 8072d32a-1154-4334-9594-be66e38e6548 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
49262024-11-27T18:36:13.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3152 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49565 req_id = 8072d32a-1154-4334-9594-be66e38e6548 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
49272024-11-27T18:36:18.741ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1115 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 9d747400-2335-4924-a804-b51ea880cc1a response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
49282024-11-27T18:36:21.573ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
49292024-11-27T18:36:21.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
49302024-11-27T18:36:21.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49312024-11-27T18:36:21.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49322024-11-27T18:36:21.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49332024-11-27T18:36:21.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49342024-11-27T18:36:21.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49352024-11-27T18:36:21.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49362024-11-27T18:36:21.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49372024-11-27T18:36:21.578ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.412286ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49382024-11-27T18:36:21.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49392024-11-27T18:36:21.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49402024-11-27T18:36:21.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49412024-11-27T18:36:21.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49422024-11-27T18:36:21.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49432024-11-27T18:36:21.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49442024-11-27T18:36:21.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
49452024-11-27T18:36:21.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49462024-11-27T18:36:21.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49472024-11-27T18:36:21.597ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
49482024-11-27T18:36:21.597ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.58021ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
49492024-11-27T18:36:28.741ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1246 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = c6b5bc4c-910f-4138-ad3c-801364049e48 response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
49502024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
49512024-11-27T18:36:31.574ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 4ce244bc-1034-4855-877d-76a08bc15b71
49522024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 22.19\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"4ce244bc-1034-4855-877d-76a08bc15b71"}
49532024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
49542024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
49552024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49562024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
49572024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
49582024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49592024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
49602024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
49612024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49622024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
49632024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
49642024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 3 reason = Timeout
49652024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49662024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
49672024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
49682024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
49692024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
49702024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49712024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49722024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
49732024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
49742024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
49752024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49762024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
49772024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
49782024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49792024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
49802024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
49812024-11-27T18:36:31.574ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
49822024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49832024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
49842024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49852024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
49862024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
49872024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
49882024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
49892024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
49902024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
49912024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
49922024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49932024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
49942024-11-27T18:36:31.574ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-27 18:26:31.574769703 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
49952024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
49962024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
49972024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
49982024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49992024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50002024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
50012024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50022024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
50032024-11-27T18:36:31.574ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
50042024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
50052024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
50062024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
50072024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
50082024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
50092024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
50102024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
50112024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
50122024-11-27T18:36:31.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50132024-11-27T18:36:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
50142024-11-27T18:36:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50152024-11-27T18:36:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50162024-11-27T18:36:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
50172024-11-27T18:36:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
50182024-11-27T18:36:31.575ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("923a7051-0539-4413-bab4-c2b0d3395fe2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2225, tv_nsec: 573221095 } })
50192024-11-27T18:36:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50202024-11-27T18:36:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50212024-11-27T18:36:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50222024-11-27T18:36:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
50232024-11-27T18:36:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50242024-11-27T18:36:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50252024-11-27T18:36:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50262024-11-27T18:36:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
50272024-11-27T18:36:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
50282024-11-27T18:36:31.575ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f378a24-7578-4d72-8454-f489a3e51ffb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e203eafc-5cbd-4249-8d8a-770878ed4d6d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 2225, tv_nsec: 573398298 } })
50292024-11-27T18:36:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50302024-11-27T18:36:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
50312024-11-27T18:36:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50322024-11-27T18:36:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
50332024-11-27T18:36:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
50342024-11-27T18:36:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
50352024-11-27T18:36:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
50362024-11-27T18:36:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
50372024-11-27T18:36:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50382024-11-27T18:36:31.575ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
50392024-11-27T18:36:31.575ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.202388ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
50402024-11-27T18:36:31.575ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
50412024-11-27T18:36:31.575ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.39303ms iteration = 4 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
50422024-11-27T18:36:31.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50432024-11-27T18:36:31.579ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.446576ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
50442024-11-27T18:36:31.579ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50452024-11-27T18:36:31.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50462024-11-27T18:36:31.580ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50472024-11-27T18:36:31.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50482024-11-27T18:36:31.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50492024-11-27T18:36:31.581ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
50502024-11-27T18:36:31.581ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
50512024-11-27T18:36:31.581ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 7.159836ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
50522024-11-27T18:36:31.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50532024-11-27T18:36:31.582ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50542024-11-27T18:36:31.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50552024-11-27T18:36:31.583ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50562024-11-27T18:36:31.583ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50572024-11-27T18:36:31.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50582024-11-27T18:36:31.583ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50592024-11-27T18:36:31.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50602024-11-27T18:36:31.584ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50612024-11-27T18:36:31.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
50622024-11-27T18:36:31.586ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50632024-11-27T18:36:31.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50642024-11-27T18:36:31.586ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2225, tv_nsec: 584985310 } })
50652024-11-27T18:36:31.587ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
50662024-11-27T18:36:31.587ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2225, tv_nsec: 585953074 } })
50672024-11-27T18:36:31.588ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
50682024-11-27T18:36:31.588ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50692024-11-27T18:36:31.589ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50702024-11-27T18:36:31.590ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-27 18:26:31.574769703 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
50712024-11-27T18:36:31.590ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.628422ms iteration = 3 status = {"expiration":"2024-11-27T18:26:31.574769703Z","pruned":[]}
50722024-11-27T18:36:31.590ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.805054ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
50732024-11-27T18:36:31.590ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50742024-11-27T18:36:31.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
50752024-11-27T18:36:31.591ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50762024-11-27T18:36:31.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50772024-11-27T18:36:31.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
50782024-11-27T18:36:31.592ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50792024-11-27T18:36:31.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
50802024-11-27T18:36:31.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
50812024-11-27T18:36:31.595ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50822024-11-27T18:36:31.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50832024-11-27T18:36:31.600ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50842024-11-27T18:36:31.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50852024-11-27T18:36:31.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50862024-11-27T18:36:31.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
50872024-11-27T18:36:31.605ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50882024-11-27T18:36:31.606ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50892024-11-27T18:36:31.608ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50902024-11-27T18:36:31.608ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50912024-11-27T18:36:31.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50922024-11-27T18:36:31.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
50932024-11-27T18:36:31.612ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50942024-11-27T18:36:31.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50952024-11-27T18:36:31.612ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2225, tv_nsec: 610981905 } })
50962024-11-27T18:36:31.613ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
50972024-11-27T18:36:31.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50982024-11-27T18:36:31.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
50992024-11-27T18:36:31.617ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51002024-11-27T18:36:31.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51012024-11-27T18:36:31.642ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51022024-11-27T18:36:31.643ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 68.403824ms iteration = 5 status = {"errors":[],"records_set_to_done":[]}
51032024-11-27T18:36:31.644ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51042024-11-27T18:36:31.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
51052024-11-27T18:36:31.645ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
51062024-11-27T18:36:31.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
51072024-11-27T18:36:31.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
51082024-11-27T18:36:31.647ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51092024-11-27T18:36:31.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51102024-11-27T18:36:31.649ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 74.747668ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51112024-11-27T18:36:31.651ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51122024-11-27T18:36:31.651ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
51132024-11-27T18:36:31.651ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51142024-11-27T18:36:31.651ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51152024-11-27T18:36:31.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51162024-11-27T18:36:31.651ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51172024-11-27T18:36:31.651ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 77.037541ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
51182024-11-27T18:36:31.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51192024-11-27T18:36:31.654ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
51202024-11-27T18:36:31.654ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51212024-11-27T18:36:31.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51222024-11-27T18:36:31.659ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
51232024-11-27T18:36:31.659ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
51242024-11-27T18:36:31.659ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
51252024-11-27T18:36:31.659ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51262024-11-27T18:36:31.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51272024-11-27T18:36:31.665ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51282024-11-27T18:36:31.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51292024-11-27T18:36:31.670ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
51302024-11-27T18:36:31.670ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
51312024-11-27T18:36:31.670ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
51322024-11-27T18:36:31.670ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51332024-11-27T18:36:31.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51342024-11-27T18:36:31.672ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
51352024-11-27T18:36:31.672ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 97.690398ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
51362024-11-27T18:36:31.675ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 101.230251ms iteration = 5 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
51372024-11-27T18:36:31.690ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
51382024-11-27T18:36:31.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
51392024-11-27T18:36:31.717ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
51402024-11-27T18:36:31.725ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
51412024-11-27T18:36:31.730ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
51422024-11-27T18:36:31.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
51432024-11-27T18:36:31.739ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
51442024-11-27T18:36:31.739ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 165.352891ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
51452024-11-27T18:36:31.754ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
51462024-11-27T18:36:31.754ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51472024-11-27T18:36:31.754ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1dbb0ad9-5a10-4ef0-b2c0-3e8cf610da18", "content-length": "26", "date": "Wed, 27 Nov 2024 18:36:31 GMT"} })
51482024-11-27T18:36:31.754ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51492024-11-27T18:36:31.756ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
51502024-11-27T18:36:31.756ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51512024-11-27T18:36:31.756ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa574e10-abeb-4b3b-966e-989d5dccac6a", "content-length": "26", "date": "Wed, 27 Nov 2024 18:36:31 GMT"} })
51522024-11-27T18:36:31.756ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51532024-11-27T18:36:31.756ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
51542024-11-27T18:36:31.758ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
51552024-11-27T18:36:31.770ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
51562024-11-27T18:36:31.770ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51572024-11-27T18:36:31.770ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "825848d4-8266-4bb9-b9f6-9a6cb3402383", "content-length": "26", "date": "Wed, 27 Nov 2024 18:36:31 GMT"} })
51582024-11-27T18:36:31.770ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51592024-11-27T18:36:31.772ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
51602024-11-27T18:36:31.791ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
51612024-11-27T18:36:31.791ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51622024-11-27T18:36:31.792ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5a7ed9e-798e-49f5-bcea-7f15ddfa5331", "content-length": "372", "date": "Wed, 27 Nov 2024 18:36:31 GMT"} })
51632024-11-27T18:36:31.792ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51642024-11-27T18:36:31.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51652024-11-27T18:36:31.794ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51662024-11-27T18:36:31.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51672024-11-27T18:36:31.795ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51682024-11-27T18:36:31.795ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51692024-11-27T18:36:31.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51702024-11-27T18:36:31.797ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 222.547068ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
51712024-11-27T18:36:31.797ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51722024-11-27T18:36:31.799ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
51732024-11-27T18:36:31.799ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51742024-11-27T18:36:31.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51752024-11-27T18:36:31.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
51762024-11-27T18:36:31.800ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51772024-11-27T18:36:31.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51782024-11-27T18:36:31.834ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51792024-11-27T18:36:31.834ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
51802024-11-27T18:36:31.834ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51812024-11-27T18:36:31.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51822024-11-27T18:36:31.836ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
51832024-11-27T18:36:31.836ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
51842024-11-27T18:36:31.836ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 261.457054ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
51852024-11-27T18:36:31.838ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51862024-11-27T18:36:31.838ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 263.87896ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
51872024-11-27T18:36:31.841ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
51882024-11-27T18:36:31.841ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51892024-11-27T18:36:31.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51902024-11-27T18:36:31.843ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
51912024-11-27T18:36:31.843ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
51922024-11-27T18:36:31.843ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51932024-11-27T18:36:31.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51942024-11-27T18:36:31.843ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
51952024-11-27T18:36:31.843ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
51962024-11-27T18:36:31.844ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "dcf489f1-d90a-4264-beee-6f95ff5a50f5", "date": "Wed, 27 Nov 2024 18:36:31 GMT"} })
51972024-11-27T18:36:31.844ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51982024-11-27T18:36:31.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51992024-11-27T18:36:31.844ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52002024-11-27T18:36:31.846ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52012024-11-27T18:36:31.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52022024-11-27T18:36:31.849ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52032024-11-27T18:36:31.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52042024-11-27T18:36:31.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
52052024-11-27T18:36:31.849ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52062024-11-27T18:36:31.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52072024-11-27T18:36:31.852ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
52082024-11-27T18:36:31.852ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
52092024-11-27T18:36:31.852ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-27 18:34:43.283070 UTC dns_group = internal generation = 1
52102024-11-27T18:36:31.852ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 277.97798ms iteration = 4 status = {"generation":1}
52112024-11-27T18:36:31.852ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
52122024-11-27T18:36:31.852ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
52132024-11-27T18:36:31.853ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "74625895-1130-41d7-8787-e503ebf069d4", "date": "Wed, 27 Nov 2024 18:36:31 GMT"} })
52142024-11-27T18:36:31.854ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 279.797387ms iteration = 6 status = {}
52152024-11-27T18:36:31.854ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52162024-11-27T18:36:31.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
52172024-11-27T18:36:31.857ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52182024-11-27T18:36:31.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52192024-11-27T18:36:31.863ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
52202024-11-27T18:36:31.871ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52212024-11-27T18:36:31.871ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
52222024-11-27T18:36:31.871ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 296.839329ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
52232024-11-27T18:36:31.873ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
52242024-11-27T18:36:31.873ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 0 version = 2
52252024-11-27T18:36:31.873ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52262024-11-27T18:36:31.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52272024-11-27T18:36:31.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52282024-11-27T18:36:31.875ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
52292024-11-27T18:36:31.875ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "6faa96b3-df88-47d6-b81c-f83a208d0bdf", "date": "Wed, 27 Nov 2024 18:36:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
52302024-11-27T18:36:31.875ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
52312024-11-27T18:36:31.877ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "bc8f0451-85c5-4200-904a-deb55275f4b3", "date": "Wed, 27 Nov 2024 18:36:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
52322024-11-27T18:36:31.877ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
52332024-11-27T18:36:31.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
52342024-11-27T18:36:31.877ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52352024-11-27T18:36:31.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52362024-11-27T18:36:31.878ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
52372024-11-27T18:36:31.878ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 304.166268ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
52382024-11-27T18:36:31.879ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 1 version = 2
52392024-11-27T18:36:31.879ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
52402024-11-27T18:36:31.879ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-27 18:34:44.388958 UTC dns_group = external generation = 2
52412024-11-27T18:36:31.879ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 305.402256ms iteration = 4 status = {"generation":2}
52422024-11-27T18:36:31.893ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52432024-11-27T18:36:31.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52442024-11-27T18:36:31.895ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52452024-11-27T18:36:31.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52462024-11-27T18:36:31.895ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52472024-11-27T18:36:31.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52482024-11-27T18:36:31.897ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52492024-11-27T18:36:31.897ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52502024-11-27T18:36:31.899ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
52512024-11-27T18:36:31.899ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52522024-11-27T18:36:31.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52532024-11-27T18:36:31.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
52542024-11-27T18:36:31.900ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52552024-11-27T18:36:31.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52562024-11-27T18:36:31.901ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 327.170229ms iteration = 5 status = 0
52572024-11-27T18:36:31.903ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52582024-11-27T18:36:31.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52592024-11-27T18:36:31.905ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52602024-11-27T18:36:31.906ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
52612024-11-27T18:36:31.906ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52622024-11-27T18:36:31.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52632024-11-27T18:36:31.908ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 333.536283ms iteration = 5 status = {}
52642024-11-27T18:36:31.921ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 346.378564ms iteration = 7 status = {"physical_disks_added":0}
52652024-11-27T18:36:31.930ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
52662024-11-27T18:36:31.930ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 355.61453ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
52672024-11-27T18:36:31.940ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-27T18:34:28.564237Z, time_modified: 2024-11-27T18:34:28.564237Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
52682024-11-27T18:36:31.940ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 365.793872ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]}},"default_endpoint":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
52692024-11-27T18:36:31.940ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52702024-11-27T18:36:31.942ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
52712024-11-27T18:36:31.942ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52722024-11-27T18:36:31.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52732024-11-27T18:36:31.987ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
52742024-11-27T18:36:31.987ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0167b0f5-ec10-405e-9c6a-92d85aefd832", "content-length": "1", "date": "Wed, 27 Nov 2024 18:36:31 GMT"} })
52752024-11-27T18:36:31.989ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
52762024-11-27T18:36:31.990ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
52772024-11-27T18:36:31.990ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "8abce42b-bec1-42cf-b758-5817027506a5", "date": "Wed, 27 Nov 2024 18:36:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
52782024-11-27T18:36:31.990ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
52792024-11-27T18:36:31.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
52802024-11-27T18:36:31.991ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "bbe845c1-38ae-45e1-9e5b-b37ad21d4822", "date": "Wed, 27 Nov 2024 18:36:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
52812024-11-27T18:36:31.991ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
52822024-11-27T18:36:31.992ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 417.992635ms iteration = 5 status = null
52832024-11-27T18:36:31.993ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "04ed101f-9073-4c3b-b83c-013db220e6c5", "date": "Wed, 27 Nov 2024 18:36:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
52842024-11-27T18:36:31.993ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
52852024-11-27T18:36:31.996ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
52862024-11-27T18:36:31.996ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 421.528178ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
52872024-11-27T18:36:32.044ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
52882024-11-27T18:36:32.045ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "df88e690-2c06-431c-872b-3f1e5859b776", "content-length": "691", "date": "Wed, 27 Nov 2024 18:36:31 GMT"} })
52892024-11-27T18:36:32.045ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
52902024-11-27T18:36:32.045ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
52912024-11-27T18:36:32.045ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
52922024-11-27T18:36:32.046ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 472.097257ms iteration = 5 status = {}
52932024-11-27T18:36:32.109ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52942024-11-27T18:36:32.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52952024-11-27T18:36:32.111ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
52962024-11-27T18:36:32.111ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52972024-11-27T18:36:32.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52982024-11-27T18:36:32.123ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
52992024-11-27T18:36:32.124ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "525f4f42-18c8-40f0-8e48-5cc49004ac38", "content-length": "134", "date": "Wed, 27 Nov 2024 18:36:32 GMT"} })
53002024-11-27T18:36:32.124ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
53012024-11-27T18:36:32.124ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
53022024-11-27T18:36:32.124ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
53032024-11-27T18:36:32.124ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
53042024-11-27T18:36:32.124ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53052024-11-27T18:36:32.124ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53062024-11-27T18:36:32.124ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53072024-11-27T18:36:32.124ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
53082024-11-27T18:36:32.124ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53092024-11-27T18:36:32.124ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
53102024-11-27T18:36:32.125ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
53112024-11-27T18:36:32.125ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53122024-11-27T18:36:32.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53132024-11-27T18:36:32.127ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
53142024-11-27T18:36:32.127ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f4c1447-9eca-4a52-bca2-aa87c8ba95a8", "content-length": "2", "date": "Wed, 27 Nov 2024 18:36:32 GMT"} })
53152024-11-27T18:36:32.127ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
53162024-11-27T18:36:32.127ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "61083ecc-57c2-4e85-ac1d-92d69d0e1f1a", "content-length": "52", "date": "Wed, 27 Nov 2024 18:36:32 GMT"} })
53172024-11-27T18:36:32.127ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
53182024-11-27T18:36:32.128ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
53192024-11-27T18:36:32.261ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "dc74c505-2f22-405b-ad6b-46d28895c802", "date": "Wed, 27 Nov 2024 18:36:31 GMT"} })
53202024-11-27T18:36:32.261ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
53212024-11-27T18:36:32.261ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
53222024-11-27T18:36:32.262ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "185c6a91-2506-42e8-8718-7c51200d44ed", "content-length": "682", "date": "Wed, 27 Nov 2024 18:36:32 GMT"} })
53232024-11-27T18:36:32.262ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53242024-11-27T18:36:32.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53252024-11-27T18:36:32.265ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53262024-11-27T18:36:32.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53272024-11-27T18:36:32.269ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53282024-11-27T18:36:32.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53292024-11-27T18:36:32.273ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53302024-11-27T18:36:32.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53312024-11-27T18:36:32.281ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 706.788866ms iteration = 5 status = {}
53322024-11-27T18:36:38.741ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 982 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 85d09921-81af-444c-8913-5c89a7dc6f71 response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
53332024-11-27T18:36:41.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
53342024-11-27T18:36:41.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
53352024-11-27T18:36:41.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53362024-11-27T18:36:41.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53372024-11-27T18:36:41.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53382024-11-27T18:36:41.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53392024-11-27T18:36:41.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53402024-11-27T18:36:41.577ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53412024-11-27T18:36:41.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53422024-11-27T18:36:41.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53432024-11-27T18:36:41.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53442024-11-27T18:36:41.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53452024-11-27T18:36:41.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53462024-11-27T18:36:41.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53472024-11-27T18:36:41.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53482024-11-27T18:36:41.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
53492024-11-27T18:36:41.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53502024-11-27T18:36:41.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53512024-11-27T18:36:41.597ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
53522024-11-27T18:36:41.597ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.450993ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
53532024-11-27T18:36:41.606ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.237283ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53542024-11-27T18:36:43.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49565 req_id = e57d52ce-556c-4d0c-bbae-7c45892e2ae8 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
53552024-11-27T18:36:43.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49565 req_id = e57d52ce-556c-4d0c-bbae-7c45892e2ae8 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
53562024-11-27T18:36:43.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3578 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49565 req_id = e57d52ce-556c-4d0c-bbae-7c45892e2ae8 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
53572024-11-27T18:36:43.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49565 req_id = b5e3e6b8-fcc2-4e69-b094-9875429c80bb roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
53582024-11-27T18:36:43.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49565 req_id = b5e3e6b8-fcc2-4e69-b094-9875429c80bb resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
53592024-11-27T18:36:43.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3012 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49565 req_id = b5e3e6b8-fcc2-4e69-b094-9875429c80bb response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
53602024-11-27T18:36:48.741ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1076 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 253f21a9-500a-4f7e-bd3f-8b5441bca5a6 response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
53612024-11-27T18:36:51.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
53622024-11-27T18:36:51.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
53632024-11-27T18:36:51.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53642024-11-27T18:36:51.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53652024-11-27T18:36:51.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53662024-11-27T18:36:51.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53672024-11-27T18:36:51.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53682024-11-27T18:36:51.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53692024-11-27T18:36:51.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53702024-11-27T18:36:51.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53712024-11-27T18:36:51.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53722024-11-27T18:36:51.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53732024-11-27T18:36:51.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53742024-11-27T18:36:51.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53752024-11-27T18:36:51.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53762024-11-27T18:36:51.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
53772024-11-27T18:36:51.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53782024-11-27T18:36:51.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53792024-11-27T18:36:51.593ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
53802024-11-27T18:36:51.593ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.785033ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
53812024-11-27T18:36:51.605ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.69331ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53822024-11-27T18:36:58.742ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1247 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 56c3bc80-7da9-4b1a-b102-ddaa7742d1db response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
53832024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
53842024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53852024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
53862024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
53872024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53882024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53892024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
53902024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
53912024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
53922024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
53932024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53942024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
53952024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53962024-11-27T18:37:01.574ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
53972024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53982024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
53992024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54002024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
54012024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
54022024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54032024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
54042024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54052024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
54062024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
54072024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
54082024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
54092024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54102024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
54112024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
54122024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
54132024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
54142024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
54152024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
54162024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54172024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54182024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54192024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
54202024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54212024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54222024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
54232024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54242024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54252024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
54262024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54272024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54282024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54292024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54302024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
54312024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54322024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54332024-11-27T18:37:01.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54342024-11-27T18:37:01.576ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54352024-11-27T18:37:01.577ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54362024-11-27T18:37:01.578ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.657704ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
54372024-11-27T18:37:01.578ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2255, tv_nsec: 576006477 } })
54382024-11-27T18:37:01.578ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
54392024-11-27T18:37:01.578ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54402024-11-27T18:37:01.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
54412024-11-27T18:37:01.579ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54422024-11-27T18:37:01.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54432024-11-27T18:37:01.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54442024-11-27T18:37:01.580ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54452024-11-27T18:37:01.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54462024-11-27T18:37:01.581ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54472024-11-27T18:37:01.581ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54482024-11-27T18:37:01.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54492024-11-27T18:37:01.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54502024-11-27T18:37:01.583ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54512024-11-27T18:37:01.583ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
54522024-11-27T18:37:01.583ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54532024-11-27T18:37:01.583ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54542024-11-27T18:37:01.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54552024-11-27T18:37:01.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
54562024-11-27T18:37:01.586ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54572024-11-27T18:37:01.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54582024-11-27T18:37:01.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54592024-11-27T18:37:01.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54602024-11-27T18:37:01.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54612024-11-27T18:37:01.590ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54622024-11-27T18:37:01.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54632024-11-27T18:37:01.591ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2255, tv_nsec: 589234013 } })
54642024-11-27T18:37:01.591ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
54652024-11-27T18:37:01.592ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54662024-11-27T18:37:01.594ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54672024-11-27T18:37:01.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54682024-11-27T18:37:01.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
54692024-11-27T18:37:01.595ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54702024-11-27T18:37:01.595ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54712024-11-27T18:37:01.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54722024-11-27T18:37:01.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54732024-11-27T18:37:01.597ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54742024-11-27T18:37:01.598ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54752024-11-27T18:37:01.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54762024-11-27T18:37:01.600ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54772024-11-27T18:37:01.600ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54782024-11-27T18:37:01.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54792024-11-27T18:37:01.603ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54802024-11-27T18:37:01.603ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2255, tv_nsec: 601899240 } })
54812024-11-27T18:37:01.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54822024-11-27T18:37:01.604ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
54832024-11-27T18:37:01.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54842024-11-27T18:37:01.606ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54852024-11-27T18:37:01.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54862024-11-27T18:37:01.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
54872024-11-27T18:37:01.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54882024-11-27T18:37:01.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54892024-11-27T18:37:01.619ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
54902024-11-27T18:37:01.619ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 44.824815ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
54912024-11-27T18:37:01.619ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 45.157919ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
54922024-11-27T18:37:01.619ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54932024-11-27T18:37:01.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54942024-11-27T18:37:01.621ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54952024-11-27T18:37:01.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54962024-11-27T18:37:01.622ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54972024-11-27T18:37:01.625ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
54982024-11-27T18:37:01.625ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54992024-11-27T18:37:01.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55002024-11-27T18:37:01.626ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 52.216764ms iteration = 6 status = 0
55012024-11-27T18:37:01.628ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
55022024-11-27T18:37:01.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
55032024-11-27T18:37:01.628ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55042024-11-27T18:37:01.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55052024-11-27T18:37:01.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55062024-11-27T18:37:01.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55072024-11-27T18:37:01.635ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.878843ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55082024-11-27T18:37:01.636ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 62.0346ms iteration = 6 status = {"errors":[],"records_set_to_done":[]}
55092024-11-27T18:37:01.636ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55102024-11-27T18:37:01.636ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
55112024-11-27T18:37:01.636ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55122024-11-27T18:37:01.636ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
55132024-11-27T18:37:01.636ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 62.459866ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
55142024-11-27T18:37:01.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55152024-11-27T18:37:01.638ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
55162024-11-27T18:37:01.638ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55172024-11-27T18:37:01.638ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a9bb27a-0f29-4a74-a43d-4e841b66232f", "content-length": "26", "date": "Wed, 27 Nov 2024 18:37:01 GMT"} })
55182024-11-27T18:37:01.638ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55192024-11-27T18:37:01.639ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55202024-11-27T18:37:01.639ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
55212024-11-27T18:37:01.639ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 64.935463ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
55222024-11-27T18:37:01.641ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55232024-11-27T18:37:01.645ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
55242024-11-27T18:37:01.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
55252024-11-27T18:37:01.647ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 73.241556ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
55262024-11-27T18:37:01.654ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
55272024-11-27T18:37:01.654ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55282024-11-27T18:37:01.655ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0eb8db7a-732f-496b-87ae-03a94c7b0cae", "content-length": "26", "date": "Wed, 27 Nov 2024 18:37:01 GMT"} })
55292024-11-27T18:37:01.655ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55302024-11-27T18:37:01.657ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55312024-11-27T18:37:01.667ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 93.291673ms iteration = 6 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
55322024-11-27T18:37:01.670ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 96.410379ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
55332024-11-27T18:37:01.674ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
55342024-11-27T18:37:01.674ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55352024-11-27T18:37:01.675ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8b7103e-7e8f-42eb-9c83-13c482632833", "content-length": "26", "date": "Wed, 27 Nov 2024 18:37:01 GMT"} })
55362024-11-27T18:37:01.675ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55372024-11-27T18:37:01.676ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
55382024-11-27T18:37:01.713ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55392024-11-27T18:37:01.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55402024-11-27T18:37:01.720ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 146.063885ms iteration = 8 status = {"physical_disks_added":0}
55412024-11-27T18:37:01.753ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55422024-11-27T18:37:01.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55432024-11-27T18:37:01.755ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55442024-11-27T18:37:01.757ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55452024-11-27T18:37:01.757ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55462024-11-27T18:37:01.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55472024-11-27T18:37:01.759ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55482024-11-27T18:37:01.760ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55492024-11-27T18:37:01.760ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55502024-11-27T18:37:01.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55512024-11-27T18:37:01.814ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
55522024-11-27T18:37:01.814ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55532024-11-27T18:37:01.840ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8df3ae67-ab19-42b7-88f5-040631dcdfa2", "content-length": "372", "date": "Wed, 27 Nov 2024 18:37:01 GMT"} })
55542024-11-27T18:37:01.840ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55552024-11-27T18:37:01.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55562024-11-27T18:37:01.864ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
55572024-11-27T18:37:01.864ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
55582024-11-27T18:37:01.865ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "90e35f36-b401-4a3b-92ad-70d11ece81ed", "date": "Wed, 27 Nov 2024 18:37:01 GMT"} })
55592024-11-27T18:37:01.865ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55602024-11-27T18:37:01.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55612024-11-27T18:37:01.867ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55622024-11-27T18:37:01.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55632024-11-27T18:37:01.871ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55642024-11-27T18:37:01.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55652024-11-27T18:37:01.875ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
55662024-11-27T18:37:01.875ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55672024-11-27T18:37:01.875ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "23f22fcc-34f9-4e9e-a50f-2c5a5bfa969e", "date": "Wed, 27 Nov 2024 18:37:01 GMT"} })
55682024-11-27T18:37:01.877ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 303.033291ms iteration = 7 status = {}
55692024-11-27T18:37:01.877ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
55702024-11-27T18:37:01.878ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "acd9ba9e-fb35-46fd-87aa-ac9942b3fb1f", "content-length": "1", "date": "Wed, 27 Nov 2024 18:37:01 GMT"} })
55712024-11-27T18:37:01.879ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
55722024-11-27T18:37:01.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
55732024-11-27T18:37:01.884ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 309.67299ms iteration = 6 status = {}
55742024-11-27T18:37:01.885ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
55752024-11-27T18:37:01.886ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "98f95b9b-7e62-41e4-ab91-40763f93024d", "content-length": "691", "date": "Wed, 27 Nov 2024 18:37:01 GMT"} })
55762024-11-27T18:37:01.886ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
55772024-11-27T18:37:01.886ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
55782024-11-27T18:37:01.886ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
55792024-11-27T18:37:01.887ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 313.604578ms iteration = 6 status = null
55802024-11-27T18:37:01.888ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 313.714819ms iteration = 6 status = {}
55812024-11-27T18:37:01.927ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55822024-11-27T18:37:01.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55832024-11-27T18:37:01.930ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
55842024-11-27T18:37:01.930ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55852024-11-27T18:37:01.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55862024-11-27T18:37:01.940ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
55872024-11-27T18:37:01.940ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "fcfa896f-5538-42ce-955c-9e81ceb2e0e4", "content-length": "134", "date": "Wed, 27 Nov 2024 18:37:01 GMT"} })
55882024-11-27T18:37:01.940ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
55892024-11-27T18:37:01.940ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
55902024-11-27T18:37:01.940ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
55912024-11-27T18:37:01.940ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
55922024-11-27T18:37:01.940ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55932024-11-27T18:37:01.940ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55942024-11-27T18:37:01.940ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55952024-11-27T18:37:01.940ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
55962024-11-27T18:37:01.940ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55972024-11-27T18:37:01.940ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
55982024-11-27T18:37:01.940ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
55992024-11-27T18:37:01.940ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56002024-11-27T18:37:01.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56012024-11-27T18:37:01.942ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
56022024-11-27T18:37:01.942ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "224362b4-e433-4bd9-908a-31683434fea9", "content-length": "2", "date": "Wed, 27 Nov 2024 18:37:01 GMT"} })
56032024-11-27T18:37:01.942ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
56042024-11-27T18:37:01.943ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "14e98c0f-1cc9-4c97-a796-c5001b92140b", "content-length": "52", "date": "Wed, 27 Nov 2024 18:37:01 GMT"} })
56052024-11-27T18:37:01.943ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
56062024-11-27T18:37:01.943ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
56072024-11-27T18:37:02.069ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "18a77b67-cd1d-4351-8cd9-cc5e3e731cf5", "date": "Wed, 27 Nov 2024 18:37:01 GMT"} })
56082024-11-27T18:37:02.069ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
56092024-11-27T18:37:02.069ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
56102024-11-27T18:37:02.070ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "683394df-c799-4d3d-a66c-c6a194d6f17e", "content-length": "682", "date": "Wed, 27 Nov 2024 18:37:01 GMT"} })
56112024-11-27T18:37:02.070ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56122024-11-27T18:37:02.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56132024-11-27T18:37:02.181ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56142024-11-27T18:37:02.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56152024-11-27T18:37:02.185ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56162024-11-27T18:37:02.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56172024-11-27T18:37:02.300ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56182024-11-27T18:37:02.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56192024-11-27T18:37:02.308ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 733.774046ms iteration = 6 status = {}
56202024-11-27T18:37:06.108ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:40630
56212024-11-27T18:37:06.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40630 req_id = f9b15d00-5df2-45de-8f53-a849d94d6fe8 roles = RoleSet { roles: {} } uri = /metrics/producers
56222024-11-27T18:37:06.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40630 req_id = f9b15d00-5df2-45de-8f53-a849d94d6fe8 resource = Database result = Ok(()) uri = /metrics/producers
56232024-11-27T18:37:06.152ZINFOnexus: assigned collector to new producer collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:76 producer_id = 89a52276-2829-4963-a094-8143be2c1bad
56242024-11-27T18:37:06.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43829 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40630 req_id = f9b15d00-5df2-45de-8f53-a849d94d6fe8 response_code = 201 uri = /metrics/producers
56252024-11-27T18:37:08.741ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1290 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 0da56ef3-96cf-4b8a-8dba-82ebff447a76 response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
56262024-11-27T18:37:10.040ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:57310
56272024-11-27T18:37:10.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:57310 req_id = c1caa194-5d4d-4c54-a4b7-b07f85277ff9 roles = RoleSet { roles: {} } uri = /metrics/producers
56282024-11-27T18:37:10.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:57310 req_id = c1caa194-5d4d-4c54-a4b7-b07f85277ff9 resource = Database result = Ok(()) uri = /metrics/producers
56292024-11-27T18:37:10.087ZINFOnexus: assigned collector to new producer collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:76 producer_id = b903b497-e034-4c1d-8f82-b6e6cc8f7a53
56302024-11-27T18:37:10.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47028 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:57310 req_id = c1caa194-5d4d-4c54-a4b7-b07f85277ff9 response_code = 201 uri = /metrics/producers
56312024-11-27T18:37:11.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
56322024-11-27T18:37:11.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
56332024-11-27T18:37:11.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56342024-11-27T18:37:11.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56352024-11-27T18:37:11.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56362024-11-27T18:37:11.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56372024-11-27T18:37:11.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56382024-11-27T18:37:11.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56392024-11-27T18:37:11.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56402024-11-27T18:37:11.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56412024-11-27T18:37:11.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56422024-11-27T18:37:11.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56432024-11-27T18:37:11.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56442024-11-27T18:37:11.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
56452024-11-27T18:37:11.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56462024-11-27T18:37:11.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56472024-11-27T18:37:11.597ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
56482024-11-27T18:37:11.597ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.417217ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
56492024-11-27T18:37:11.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56502024-11-27T18:37:11.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56512024-11-27T18:37:11.638ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.203431ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56522024-11-27T18:37:13.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49565 req_id = 5cf08553-ee85-4281-aec2-3af931a60748 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
56532024-11-27T18:37:13.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49565 req_id = 5cf08553-ee85-4281-aec2-3af931a60748 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
56542024-11-27T18:37:13.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49565 req_id = 5cf08553-ee85-4281-aec2-3af931a60748 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
56552024-11-27T18:37:13.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49565 req_id = 8ffe03ae-3341-48f0-a1e1-29693cb87e55 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
56562024-11-27T18:37:13.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49565 req_id = 8ffe03ae-3341-48f0-a1e1-29693cb87e55 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
56572024-11-27T18:37:13.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2730 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49565 req_id = 8ffe03ae-3341-48f0-a1e1-29693cb87e55 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
56582024-11-27T18:37:14.957ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
56592024-11-27T18:37:14.957ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
56602024-11-27T18:37:14.987ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
56612024-11-27T18:37:14.987ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:55510
56622024-11-27T18:37:14.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:55510 req_id = bc67cd79-1f83-4805-801a-816983224fe3 roles = RoleSet { roles: {} } uri = /metrics/producers
56632024-11-27T18:37:14.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:55510 req_id = bc67cd79-1f83-4805-801a-816983224fe3 resource = Database result = Ok(()) uri = /metrics/producers
56642024-11-27T18:37:14.997ZINFOnexus: assigned collector to new producer collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:76 producer_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
56652024-11-27T18:37:14.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9411 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:55510 req_id = bc67cd79-1f83-4805-801a-816983224fe3 response_code = 201 uri = /metrics/producers
56662024-11-27T18:37:14.997ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "bc67cd79-1f83-4805-801a-816983224fe3", "content-length": "41", "date": "Wed, 27 Nov 2024 18:37:14 GMT"} })
56672024-11-27T18:37:14.998ZDEBGnexus (producer-registration-task): registered with nexus successfully
56682024-11-27T18:37:14.998ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
56692024-11-27T18:37:18.742ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1754 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = e7ac0673-9134-42de-b0d2-0fd9a7ad590f response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
56702024-11-27T18:37:21.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
56712024-11-27T18:37:21.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
56722024-11-27T18:37:21.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56732024-11-27T18:37:21.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56742024-11-27T18:37:21.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56752024-11-27T18:37:21.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56762024-11-27T18:37:21.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56772024-11-27T18:37:21.577ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56782024-11-27T18:37:21.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56792024-11-27T18:37:21.579ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.291473ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56802024-11-27T18:37:21.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56812024-11-27T18:37:21.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56822024-11-27T18:37:21.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56832024-11-27T18:37:21.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56842024-11-27T18:37:21.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56852024-11-27T18:37:21.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56862024-11-27T18:37:21.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
56872024-11-27T18:37:21.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56882024-11-27T18:37:21.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56892024-11-27T18:37:21.595ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
56902024-11-27T18:37:21.595ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.012741ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
56912024-11-27T18:37:24.003ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:46108
56922024-11-27T18:37:24.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46108 req_id = 70de5e8a-c02e-4269-b232-74f3531ac7c8 roles = RoleSet { roles: {} } uri = /metrics/producers
56932024-11-27T18:37:24.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46108 req_id = 70de5e8a-c02e-4269-b232-74f3531ac7c8 resource = Database result = Ok(()) uri = /metrics/producers
56942024-11-27T18:37:24.057ZINFOnexus: assigned collector to new producer collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:76 producer_id = 761834fc-a72f-4e26-9e1f-c4047ccf5da9
56952024-11-27T18:37:24.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53571 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46108 req_id = 70de5e8a-c02e-4269-b232-74f3531ac7c8 response_code = 201 uri = /metrics/producers
56962024-11-27T18:37:27.007ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:53521
56972024-11-27T18:37:27.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53521 req_id = 59e6f9be-7815-49a3-8c84-8b94e8f7cfe7 roles = RoleSet { roles: {} } uri = /metrics/producers
56982024-11-27T18:37:27.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53521 req_id = 59e6f9be-7815-49a3-8c84-8b94e8f7cfe7 resource = Database result = Ok(()) uri = /metrics/producers
56992024-11-27T18:37:27.046ZINFOnexus: assigned collector to new producer collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:76 producer_id = f3f7f234-938f-4eb4-84cd-9acd73e59924
57002024-11-27T18:37:27.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38493 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53521 req_id = 59e6f9be-7815-49a3-8c84-8b94e8f7cfe7 response_code = 201 uri = /metrics/producers
57012024-11-27T18:37:28.742ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1391 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 6acebbd5-7778-4ac6-b7dd-d87a26e3e4eb response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
57022024-11-27T18:37:30.835ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:60145
57032024-11-27T18:37:30.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:60145 req_id = 24ecffee-5b10-41e0-bed1-3e2ef5114b17 roles = RoleSet { roles: {} } uri = /metrics/producers
57042024-11-27T18:37:30.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:60145 req_id = 24ecffee-5b10-41e0-bed1-3e2ef5114b17 resource = Database result = Ok(()) uri = /metrics/producers
57052024-11-27T18:37:30.870ZINFOnexus: assigned collector to new producer collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:76 producer_id = b844cfb5-ff43-41f6-a61d-f7949f48466b
57062024-11-27T18:37:30.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35231 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:60145 req_id = 24ecffee-5b10-41e0-bed1-3e2ef5114b17 response_code = 201 uri = /metrics/producers
57072024-11-27T18:37:31.574ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
57082024-11-27T18:37:31.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
57092024-11-27T18:37:31.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
57102024-11-27T18:37:31.574ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
57112024-11-27T18:37:31.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57122024-11-27T18:37:31.574ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
57132024-11-27T18:37:31.574ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
57142024-11-27T18:37:31.574ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57152024-11-27T18:37:31.574ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
57162024-11-27T18:37:31.574ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57172024-11-27T18:37:31.574ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
57182024-11-27T18:37:31.574ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
57192024-11-27T18:37:31.574ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
57202024-11-27T18:37:31.574ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
57212024-11-27T18:37:31.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57222024-11-27T18:37:31.574ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
57232024-11-27T18:37:31.574ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
57242024-11-27T18:37:31.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
57252024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57262024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
57272024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57282024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
57292024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
57302024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
57312024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
57322024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
57332024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
57342024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57352024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57362024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
57372024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57382024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
57392024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57402024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
57412024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
57422024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
57432024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57442024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
57452024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
57462024-11-27T18:37:31.575ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-27 18:27:31.575059844 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
57472024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
57482024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
57492024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
57502024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
57512024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
57522024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
57532024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
57542024-11-27T18:37:31.575ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 4ce244bc-1034-4855-877d-76a08bc15b71
57552024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
57562024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.8\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"4ce244bc-1034-4855-877d-76a08bc15b71"}
57572024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
57582024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
57592024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
57602024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
57612024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
57622024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
57632024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
57642024-11-27T18:37:31.575ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
57652024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
57662024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
57672024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57682024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
57692024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57702024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
57712024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
57722024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
57732024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
57742024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
57752024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57762024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57772024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
57782024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57792024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
57802024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57812024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57822024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
57832024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57842024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57852024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57862024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
57872024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57882024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
57892024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57902024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
57912024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
57922024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
57932024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
57942024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
57952024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
57962024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
57972024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
57982024-11-27T18:37:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57992024-11-27T18:37:31.575ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f378a24-7578-4d72-8454-f489a3e51ffb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e203eafc-5cbd-4249-8d8a-770878ed4d6d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 2285, tv_nsec: 573648662 } })
58002024-11-27T18:37:31.575ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("923a7051-0539-4413-bab4-c2b0d3395fe2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2285, tv_nsec: 573666292 } })
58012024-11-27T18:37:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
58022024-11-27T18:37:31.576ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
58032024-11-27T18:37:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
58042024-11-27T18:37:31.576ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
58052024-11-27T18:37:31.576ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
58062024-11-27T18:37:31.576ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.34581ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
58072024-11-27T18:37:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
58082024-11-27T18:37:31.576ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
58092024-11-27T18:37:31.576ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.29964ms iteration = 5 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
58102024-11-27T18:37:31.579ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58112024-11-27T18:37:31.579ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.938959ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
58122024-11-27T18:37:31.579ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58132024-11-27T18:37:31.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58142024-11-27T18:37:31.579ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58152024-11-27T18:37:31.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58162024-11-27T18:37:31.580ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58172024-11-27T18:37:31.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
58182024-11-27T18:37:31.581ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
58192024-11-27T18:37:31.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
58202024-11-27T18:37:31.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58212024-11-27T18:37:31.582ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58222024-11-27T18:37:31.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58232024-11-27T18:37:31.583ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58242024-11-27T18:37:31.583ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58252024-11-27T18:37:31.584ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58262024-11-27T18:37:31.585ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58272024-11-27T18:37:31.585ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58282024-11-27T18:37:31.585ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2285, tv_nsec: 583067112 } })
58292024-11-27T18:37:31.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58302024-11-27T18:37:31.585ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
58312024-11-27T18:37:31.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
58322024-11-27T18:37:31.587ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58332024-11-27T18:37:31.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
58342024-11-27T18:37:31.587ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58352024-11-27T18:37:31.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58362024-11-27T18:37:31.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58372024-11-27T18:37:31.592ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58382024-11-27T18:37:31.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58392024-11-27T18:37:31.592ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-27 18:27:31.575059844 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
58402024-11-27T18:37:31.592ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 17.720723ms iteration = 4 status = {"expiration":"2024-11-27T18:27:31.575059844Z","pruned":[]}
58412024-11-27T18:37:31.596ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.9233ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
58422024-11-27T18:37:31.597ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2285, tv_nsec: 594798646 } })
58432024-11-27T18:37:31.597ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
58442024-11-27T18:37:31.598ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58452024-11-27T18:37:31.600ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
58462024-11-27T18:37:31.600ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
58472024-11-27T18:37:31.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
58482024-11-27T18:37:31.602ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58492024-11-27T18:37:31.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58502024-11-27T18:37:31.604ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58512024-11-27T18:37:31.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58522024-11-27T18:37:31.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
58532024-11-27T18:37:31.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
58542024-11-27T18:37:31.606ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
58552024-11-27T18:37:31.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
58562024-11-27T18:37:31.606ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58572024-11-27T18:37:31.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
58582024-11-27T18:37:31.610ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
58592024-11-27T18:37:31.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
58602024-11-27T18:37:31.612ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58612024-11-27T18:37:31.612ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58622024-11-27T18:37:31.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58632024-11-27T18:37:31.614ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2285, tv_nsec: 611894359 } })
58642024-11-27T18:37:31.614ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
58652024-11-27T18:37:31.615ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
58662024-11-27T18:37:31.615ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
58672024-11-27T18:37:31.615ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 40.44323ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
58682024-11-27T18:37:31.615ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58692024-11-27T18:37:31.615ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58702024-11-27T18:37:31.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58712024-11-27T18:37:31.617ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58722024-11-27T18:37:31.621ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
58732024-11-27T18:37:31.623ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
58742024-11-27T18:37:31.623ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
58752024-11-27T18:37:31.623ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
58762024-11-27T18:37:31.623ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58772024-11-27T18:37:31.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58782024-11-27T18:37:31.624ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58792024-11-27T18:37:31.624ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 50.042771ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
58802024-11-27T18:37:31.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58812024-11-27T18:37:31.626ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58822024-11-27T18:37:31.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58832024-11-27T18:37:31.627ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58842024-11-27T18:37:31.629ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58852024-11-27T18:37:31.631ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58862024-11-27T18:37:31.631ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
58872024-11-27T18:37:31.631ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58882024-11-27T18:37:31.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58892024-11-27T18:37:31.631ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
58902024-11-27T18:37:31.631ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58912024-11-27T18:37:31.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58922024-11-27T18:37:31.633ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58932024-11-27T18:37:31.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58942024-11-27T18:37:31.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58952024-11-27T18:37:31.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58962024-11-27T18:37:31.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58972024-11-27T18:37:31.635ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58982024-11-27T18:37:31.636ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
58992024-11-27T18:37:31.636ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59002024-11-27T18:37:31.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59012024-11-27T18:37:31.637ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59022024-11-27T18:37:31.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59032024-11-27T18:37:31.638ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59042024-11-27T18:37:31.638ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.214857ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59052024-11-27T18:37:31.642ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
59062024-11-27T18:37:31.642ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59072024-11-27T18:37:31.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59082024-11-27T18:37:31.644ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
59092024-11-27T18:37:31.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
59102024-11-27T18:37:31.645ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59112024-11-27T18:37:31.645ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59122024-11-27T18:37:31.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59132024-11-27T18:37:31.646ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 71.007193ms iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
59142024-11-27T18:37:31.646ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59152024-11-27T18:37:31.646ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59162024-11-27T18:37:31.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
59172024-11-27T18:37:31.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
59182024-11-27T18:37:31.648ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
59192024-11-27T18:37:31.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
59202024-11-27T18:37:31.649ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
59212024-11-27T18:37:31.649ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59222024-11-27T18:37:31.649ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 74.360303ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
59232024-11-27T18:37:31.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59242024-11-27T18:37:31.649ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 74.605756ms iteration = 7 status = {"errors":[],"records_set_to_done":[]}
59252024-11-27T18:37:31.650ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59262024-11-27T18:37:31.651ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59272024-11-27T18:37:31.651ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59282024-11-27T18:37:31.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59292024-11-27T18:37:31.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59302024-11-27T18:37:31.653ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59312024-11-27T18:37:31.653ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 78.698407ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
59322024-11-27T18:37:31.653ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
59332024-11-27T18:37:31.653ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
59342024-11-27T18:37:31.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
59352024-11-27T18:37:31.655ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 80.95723ms iteration = 3 status = {"nsuccess":5}
59362024-11-27T18:37:31.657ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
59372024-11-27T18:37:31.657ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
59382024-11-27T18:37:31.657ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
59392024-11-27T18:37:31.657ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59402024-11-27T18:37:31.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59412024-11-27T18:37:31.657ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
59422024-11-27T18:37:31.657ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59432024-11-27T18:37:31.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59442024-11-27T18:37:31.658ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59452024-11-27T18:37:31.660ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59462024-11-27T18:37:31.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59472024-11-27T18:37:31.662ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59482024-11-27T18:37:31.663ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
59492024-11-27T18:37:31.663ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59502024-11-27T18:37:31.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59512024-11-27T18:37:31.664ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
59522024-11-27T18:37:31.664ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59532024-11-27T18:37:31.664ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
59542024-11-27T18:37:31.664ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 89.71026ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
59552024-11-27T18:37:31.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59562024-11-27T18:37:31.668ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
59572024-11-27T18:37:31.668ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 0 version = 2
59582024-11-27T18:37:31.668ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59592024-11-27T18:37:31.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59602024-11-27T18:37:31.670ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59612024-11-27T18:37:31.675ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
59622024-11-27T18:37:31.675ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59632024-11-27T18:37:31.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59642024-11-27T18:37:31.677ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59652024-11-27T18:37:31.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59662024-11-27T18:37:31.677ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 1 version = 2
59672024-11-27T18:37:31.677ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
59682024-11-27T18:37:31.677ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-27 18:34:44.388958 UTC dns_group = external generation = 2
59692024-11-27T18:37:31.677ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 102.858674ms iteration = 5 status = {"generation":2}
59702024-11-27T18:37:31.679ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
59712024-11-27T18:37:31.679ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
59722024-11-27T18:37:31.679ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59732024-11-27T18:37:31.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59742024-11-27T18:37:31.684ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
59752024-11-27T18:37:31.685ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59762024-11-27T18:37:31.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59772024-11-27T18:37:31.686ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59782024-11-27T18:37:31.687ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59792024-11-27T18:37:31.687ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59802024-11-27T18:37:31.688ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 113.30768ms iteration = 9 status = {"physical_disks_added":0}
59812024-11-27T18:37:31.691ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
59822024-11-27T18:37:31.691ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59832024-11-27T18:37:31.691ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
59842024-11-27T18:37:31.691ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59852024-11-27T18:37:31.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59862024-11-27T18:37:31.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59872024-11-27T18:37:31.691ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
59882024-11-27T18:37:31.691ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59892024-11-27T18:37:31.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59902024-11-27T18:37:31.693ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59912024-11-27T18:37:31.693ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
59922024-11-27T18:37:31.693ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 118.659309ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
59932024-11-27T18:37:31.693ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 118.464976ms iteration = 7 status = 0
59942024-11-27T18:37:31.695ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
59952024-11-27T18:37:31.695ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
59962024-11-27T18:37:31.695ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
59972024-11-27T18:37:31.695ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 120.112071ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
59982024-11-27T18:37:31.695ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
59992024-11-27T18:37:31.695ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
60002024-11-27T18:37:31.695ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-27 18:34:43.283070 UTC dns_group = internal generation = 1
60012024-11-27T18:37:31.695ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 120.323324ms iteration = 5 status = {"generation":1}
60022024-11-27T18:37:31.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
60032024-11-27T18:37:31.702ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
60042024-11-27T18:37:31.702ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 127.260387ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
60052024-11-27T18:37:31.702ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
60062024-11-27T18:37:31.702ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 127.641112ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
60072024-11-27T18:37:31.721ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-27T18:34:28.564237Z, time_modified: 2024-11-27T18:34:28.564237Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }) }
60082024-11-27T18:37:31.721ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 146.472191ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]}},"default_endpoint":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
60092024-11-27T18:37:31.724ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
60102024-11-27T18:37:31.740ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60112024-11-27T18:37:31.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60122024-11-27T18:37:31.743ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
60132024-11-27T18:37:31.743ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60142024-11-27T18:37:31.743ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d44fb34-baa5-461d-a4e2-73ed22557720", "content-length": "26", "date": "Wed, 27 Nov 2024 18:37:31 GMT"} })
60152024-11-27T18:37:31.743ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60162024-11-27T18:37:31.745ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
60172024-11-27T18:37:31.745ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60182024-11-27T18:37:31.745ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6b6678e-15ca-4b97-a8c1-8082edc7f74c", "content-length": "26", "date": "Wed, 27 Nov 2024 18:37:31 GMT"} })
60192024-11-27T18:37:31.745ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60202024-11-27T18:37:31.745ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
60212024-11-27T18:37:31.745ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
60222024-11-27T18:37:31.745ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60232024-11-27T18:37:31.746ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "05928994-f331-4ca7-b35c-4ac10f50556a", "content-length": "26", "date": "Wed, 27 Nov 2024 18:37:31 GMT"} })
60242024-11-27T18:37:31.746ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60252024-11-27T18:37:31.747ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
60262024-11-27T18:37:31.748ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
60272024-11-27T18:37:31.844ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
60282024-11-27T18:37:31.902ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 327.122288ms iteration = 7 status = {}
60292024-11-27T18:37:31.934ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
60302024-11-27T18:37:31.934ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc5d069e-28f6-4814-b10d-92ca1aa586c3", "content-length": "1", "date": "Wed, 27 Nov 2024 18:37:31 GMT"} })
60312024-11-27T18:37:31.935ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
60322024-11-27T18:37:31.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
60332024-11-27T18:37:31.972ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
60342024-11-27T18:37:31.972ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "475fdca8-2408-40f4-bf40-b9a8654e3aae", "date": "Wed, 27 Nov 2024 18:37:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
60352024-11-27T18:37:31.972ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
60362024-11-27T18:37:31.977ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "467da54a-82bb-4af4-a664-a5ac15050e0e", "date": "Wed, 27 Nov 2024 18:37:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
60372024-11-27T18:37:31.977ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
60382024-11-27T18:37:31.979ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f176b208-f7d0-42ec-8a6e-58a56e971dcc", "date": "Wed, 27 Nov 2024 18:37:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
60392024-11-27T18:37:31.979ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
60402024-11-27T18:37:31.981ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
60412024-11-27T18:37:31.981ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 406.262161ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
60422024-11-27T18:37:31.991ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
60432024-11-27T18:37:31.991ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
60442024-11-27T18:37:31.992ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4917318-80ac-4ee3-9e9c-f18b70dd1c8a", "content-length": "372", "date": "Wed, 27 Nov 2024 18:37:31 GMT"} })
60452024-11-27T18:37:31.992ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60462024-11-27T18:37:31.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60472024-11-27T18:37:31.993ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60482024-11-27T18:37:31.994ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 419.769911ms iteration = 7 status = null
60492024-11-27T18:37:31.996ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
60502024-11-27T18:37:31.996ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60512024-11-27T18:37:31.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60522024-11-27T18:37:31.997ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
60532024-11-27T18:37:31.997ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "a404a731-7c86-45af-98fc-ef9d13a419f2", "date": "Wed, 27 Nov 2024 18:37:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
60542024-11-27T18:37:31.997ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
60552024-11-27T18:37:31.999ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60562024-11-27T18:37:32.000ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "246f453b-d29f-4773-9190-cbbf8045a6aa", "date": "Wed, 27 Nov 2024 18:37:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
60572024-11-27T18:37:32.000ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
60582024-11-27T18:37:32.002ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
60592024-11-27T18:37:32.002ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60602024-11-27T18:37:32.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60612024-11-27T18:37:32.002ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
60622024-11-27T18:37:32.002ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 427.477025ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
60632024-11-27T18:37:32.078ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
60642024-11-27T18:37:32.078ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
60652024-11-27T18:37:32.078ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "284bf517-593e-457f-ba22-43e6e0e6e147", "date": "Wed, 27 Nov 2024 18:37:31 GMT"} })
60662024-11-27T18:37:32.078ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60672024-11-27T18:37:32.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60682024-11-27T18:37:32.083ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60692024-11-27T18:37:32.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60702024-11-27T18:37:32.086ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60712024-11-27T18:37:32.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60722024-11-27T18:37:32.089ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
60732024-11-27T18:37:32.090ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
60742024-11-27T18:37:32.090ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bf4e9763-6349-443c-aecd-96386e883dcd", "date": "Wed, 27 Nov 2024 18:37:31 GMT"} })
60752024-11-27T18:37:32.092ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 517.680923ms iteration = 8 status = {}
60762024-11-27T18:37:32.096ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
60772024-11-27T18:37:32.104ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60782024-11-27T18:37:32.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60792024-11-27T18:37:32.106ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
60802024-11-27T18:37:32.106ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60812024-11-27T18:37:32.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60822024-11-27T18:37:32.114ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
60832024-11-27T18:37:32.114ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e6f6d57-e9b7-4f2c-bf3c-a495b8824c67", "content-length": "134", "date": "Wed, 27 Nov 2024 18:37:31 GMT"} })
60842024-11-27T18:37:32.114ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
60852024-11-27T18:37:32.114ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
60862024-11-27T18:37:32.114ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
60872024-11-27T18:37:32.114ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
60882024-11-27T18:37:32.114ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60892024-11-27T18:37:32.114ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60902024-11-27T18:37:32.114ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60912024-11-27T18:37:32.114ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
60922024-11-27T18:37:32.114ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60932024-11-27T18:37:32.114ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
60942024-11-27T18:37:32.115ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
60952024-11-27T18:37:32.115ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60962024-11-27T18:37:32.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60972024-11-27T18:37:32.116ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
60982024-11-27T18:37:32.116ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9ee3935-9fd8-4d1c-b32f-aaf6f6e220e7", "content-length": "2", "date": "Wed, 27 Nov 2024 18:37:31 GMT"} })
60992024-11-27T18:37:32.116ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
61002024-11-27T18:37:32.116ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "265b26c6-9bac-4bdc-b49a-b2e18416fe9a", "content-length": "52", "date": "Wed, 27 Nov 2024 18:37:31 GMT"} })
61012024-11-27T18:37:32.116ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
61022024-11-27T18:37:32.116ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
61032024-11-27T18:37:32.195ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "011d8822-3b03-4f42-b76d-c095567715de", "content-length": "691", "date": "Wed, 27 Nov 2024 18:37:31 GMT"} })
61042024-11-27T18:37:32.195ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
61052024-11-27T18:37:32.195ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
61062024-11-27T18:37:32.195ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
61072024-11-27T18:37:32.197ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 622.202352ms iteration = 7 status = {}
61082024-11-27T18:37:32.286ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4a029ff5-dcaa-4450-be43-aaf2aff051c0", "date": "Wed, 27 Nov 2024 18:37:32 GMT"} })
61092024-11-27T18:37:32.286ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
61102024-11-27T18:37:32.286ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
61112024-11-27T18:37:32.286ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b9a74f0-1ea8-42f8-bd45-a936c45702ca", "content-length": "682", "date": "Wed, 27 Nov 2024 18:37:32 GMT"} })
61122024-11-27T18:37:32.286ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61132024-11-27T18:37:32.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61142024-11-27T18:37:32.290ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61152024-11-27T18:37:32.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61162024-11-27T18:37:32.293ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61172024-11-27T18:37:32.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61182024-11-27T18:37:32.295ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61192024-11-27T18:37:32.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61202024-11-27T18:37:32.303ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 728.317345ms iteration = 7 status = {}
61212024-11-27T18:37:38.742ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1119 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 8a328ef4-013b-42fa-ab53-064dec07cb26 response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
61222024-11-27T18:37:41.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
61232024-11-27T18:37:41.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
61242024-11-27T18:37:41.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61252024-11-27T18:37:41.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61262024-11-27T18:37:41.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61272024-11-27T18:37:41.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61282024-11-27T18:37:41.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61292024-11-27T18:37:41.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61302024-11-27T18:37:41.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61312024-11-27T18:37:41.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61322024-11-27T18:37:41.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61332024-11-27T18:37:41.578ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.410315ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61342024-11-27T18:37:41.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61352024-11-27T18:37:41.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61362024-11-27T18:37:41.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61372024-11-27T18:37:41.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61382024-11-27T18:37:41.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
61392024-11-27T18:37:41.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61402024-11-27T18:37:41.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61412024-11-27T18:37:41.595ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
61422024-11-27T18:37:41.595ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.655646ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
61432024-11-27T18:37:48.741ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1034 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 58020ec7-8b59-4687-8e29-19ac184bf24d response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
61442024-11-27T18:37:51.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
61452024-11-27T18:37:51.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
61462024-11-27T18:37:51.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61472024-11-27T18:37:51.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61482024-11-27T18:37:51.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61492024-11-27T18:37:51.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61502024-11-27T18:37:51.577ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61512024-11-27T18:37:51.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61522024-11-27T18:37:51.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61532024-11-27T18:37:51.579ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.358254ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61542024-11-27T18:37:51.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61552024-11-27T18:37:51.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61562024-11-27T18:37:51.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61572024-11-27T18:37:51.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61582024-11-27T18:37:51.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61592024-11-27T18:37:51.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61602024-11-27T18:37:51.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
61612024-11-27T18:37:51.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61622024-11-27T18:37:51.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61632024-11-27T18:37:51.597ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
61642024-11-27T18:37:51.598ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.224864ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
61652024-11-27T18:37:58.742ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1183 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 1e596589-b954-4102-85ba-109533ea825c response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
61662024-11-27T18:38:01.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
61672024-11-27T18:38:01.574ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
61682024-11-27T18:38:01.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61692024-11-27T18:38:01.574ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
61702024-11-27T18:38:01.574ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
61712024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61722024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
61732024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
61742024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61752024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61762024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
61772024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61782024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
61792024-11-27T18:38:01.575ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
61802024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
61812024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61822024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61832024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
61842024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
61852024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
61862024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
61872024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
61882024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
61892024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
61902024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
61912024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
61922024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
61932024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
61942024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61952024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
61962024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
61972024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
61982024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61992024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
62002024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62012024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62022024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62032024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
62042024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62052024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62062024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62072024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
62082024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62092024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62102024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62112024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62122024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62132024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62142024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
62152024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62162024-11-27T18:38:01.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62172024-11-27T18:38:01.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62182024-11-27T18:38:01.578ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62192024-11-27T18:38:01.579ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2315, tv_nsec: 577125273 } })
62202024-11-27T18:38:01.579ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62212024-11-27T18:38:01.579ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
62222024-11-27T18:38:01.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62232024-11-27T18:38:01.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62242024-11-27T18:38:01.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62252024-11-27T18:38:01.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
62262024-11-27T18:38:01.581ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62272024-11-27T18:38:01.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62282024-11-27T18:38:01.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
62292024-11-27T18:38:01.582ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62302024-11-27T18:38:01.582ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62312024-11-27T18:38:01.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62322024-11-27T18:38:01.583ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62332024-11-27T18:38:01.585ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2315, tv_nsec: 582758807 } })
62342024-11-27T18:38:01.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
62352024-11-27T18:38:01.585ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62362024-11-27T18:38:01.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62372024-11-27T18:38:01.585ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
62382024-11-27T18:38:01.585ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62392024-11-27T18:38:01.585ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62402024-11-27T18:38:01.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62412024-11-27T18:38:01.587ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62422024-11-27T18:38:01.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
62432024-11-27T18:38:01.589ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62442024-11-27T18:38:01.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62452024-11-27T18:38:01.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62462024-11-27T18:38:01.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62472024-11-27T18:38:01.590ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
62482024-11-27T18:38:01.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62492024-11-27T18:38:01.591ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62502024-11-27T18:38:01.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62512024-11-27T18:38:01.592ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2315, tv_nsec: 589866782 } })
62522024-11-27T18:38:01.592ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62532024-11-27T18:38:01.592ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
62542024-11-27T18:38:01.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62552024-11-27T18:38:01.593ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62562024-11-27T18:38:01.594ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62572024-11-27T18:38:01.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
62582024-11-27T18:38:01.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62592024-11-27T18:38:01.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62602024-11-27T18:38:01.597ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
62612024-11-27T18:38:01.597ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62622024-11-27T18:38:01.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62632024-11-27T18:38:01.612ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
62642024-11-27T18:38:01.612ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 37.993174ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
62652024-11-27T18:38:01.612ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 37.83675ms iteration = 8 status = {"errors":[],"records_set_to_done":[]}
62662024-11-27T18:38:01.613ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 38.219387ms iteration = 10 status = {"physical_disks_added":0}
62672024-11-27T18:38:01.624ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 49.811948ms iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
62682024-11-27T18:38:01.624ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62692024-11-27T18:38:01.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62702024-11-27T18:38:01.626ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62712024-11-27T18:38:01.626ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 51.857389ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
62722024-11-27T18:38:01.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62732024-11-27T18:38:01.628ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62742024-11-27T18:38:01.628ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
62752024-11-27T18:38:01.628ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62762024-11-27T18:38:01.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62772024-11-27T18:38:01.629ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62782024-11-27T18:38:01.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62792024-11-27T18:38:01.630ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62802024-11-27T18:38:01.630ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
62812024-11-27T18:38:01.630ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62822024-11-27T18:38:01.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62832024-11-27T18:38:01.632ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62842024-11-27T18:38:01.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62852024-11-27T18:38:01.634ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62862024-11-27T18:38:01.634ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62872024-11-27T18:38:01.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62882024-11-27T18:38:01.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62892024-11-27T18:38:01.635ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62902024-11-27T18:38:01.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62912024-11-27T18:38:01.635ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
62922024-11-27T18:38:01.635ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 60.877112ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
62932024-11-27T18:38:01.637ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62942024-11-27T18:38:01.637ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62952024-11-27T18:38:01.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62962024-11-27T18:38:01.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
62972024-11-27T18:38:01.637ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62982024-11-27T18:38:01.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62992024-11-27T18:38:01.639ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 64.10136ms iteration = 8 status = 0
63002024-11-27T18:38:01.639ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.284113ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63012024-11-27T18:38:01.652ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
63022024-11-27T18:38:01.652ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63032024-11-27T18:38:01.652ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e530cdaa-d5ca-4d57-8c76-5b38db194e66", "content-length": "26", "date": "Wed, 27 Nov 2024 18:38:01 GMT"} })
63042024-11-27T18:38:01.652ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63052024-11-27T18:38:01.654ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63062024-11-27T18:38:01.659ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 84.404442ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
63072024-11-27T18:38:01.661ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63082024-11-27T18:38:01.661ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
63092024-11-27T18:38:01.661ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 86.756266ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
63102024-11-27T18:38:01.662ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63112024-11-27T18:38:01.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63122024-11-27T18:38:01.664ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 89.937973ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
63132024-11-27T18:38:01.672ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
63142024-11-27T18:38:01.672ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63152024-11-27T18:38:01.673ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "92b6e3ee-443c-4349-9045-7b269acefda4", "content-length": "26", "date": "Wed, 27 Nov 2024 18:38:01 GMT"} })
63162024-11-27T18:38:01.673ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63172024-11-27T18:38:01.674ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63182024-11-27T18:38:01.685ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
63192024-11-27T18:38:01.685ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63202024-11-27T18:38:01.685ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e575e52-ff55-446b-96e7-75a8a4570952", "content-length": "26", "date": "Wed, 27 Nov 2024 18:38:01 GMT"} })
63212024-11-27T18:38:01.685ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63222024-11-27T18:38:01.685ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 110.695581ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
63232024-11-27T18:38:01.686ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
63242024-11-27T18:38:01.733ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
63252024-11-27T18:38:01.733ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
63262024-11-27T18:38:01.734ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "142aecd0-0067-411c-a465-29e21fea52b3", "content-length": "372", "date": "Wed, 27 Nov 2024 18:38:01 GMT"} })
63272024-11-27T18:38:01.734ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63282024-11-27T18:38:01.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63292024-11-27T18:38:01.758ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
63302024-11-27T18:38:01.759ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "524840e8-7c8a-4612-a179-414a6ffffae1", "content-length": "1", "date": "Wed, 27 Nov 2024 18:38:00 GMT"} })
63312024-11-27T18:38:01.760ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 185.265286ms iteration = 8 status = {}
63322024-11-27T18:38:01.761ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
63332024-11-27T18:38:01.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
63342024-11-27T18:38:01.763ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 188.180908ms iteration = 8 status = null
63352024-11-27T18:38:01.770ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63362024-11-27T18:38:01.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63372024-11-27T18:38:01.772ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63382024-11-27T18:38:01.774ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63392024-11-27T18:38:01.774ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63402024-11-27T18:38:01.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63412024-11-27T18:38:01.775ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63422024-11-27T18:38:01.777ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63432024-11-27T18:38:01.777ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63442024-11-27T18:38:01.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63452024-11-27T18:38:01.817ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
63462024-11-27T18:38:01.831ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63472024-11-27T18:38:01.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63482024-11-27T18:38:01.834ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
63492024-11-27T18:38:01.834ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63502024-11-27T18:38:01.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63512024-11-27T18:38:01.843ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
63522024-11-27T18:38:01.843ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3d36250-37d2-4bb1-a5e1-dedd0d0da227", "content-length": "134", "date": "Wed, 27 Nov 2024 18:38:00 GMT"} })
63532024-11-27T18:38:01.843ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
63542024-11-27T18:38:01.843ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
63552024-11-27T18:38:01.844ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
63562024-11-27T18:38:01.844ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
63572024-11-27T18:38:01.844ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63582024-11-27T18:38:01.844ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63592024-11-27T18:38:01.844ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63602024-11-27T18:38:01.844ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
63612024-11-27T18:38:01.844ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63622024-11-27T18:38:01.844ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
63632024-11-27T18:38:01.844ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
63642024-11-27T18:38:01.844ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63652024-11-27T18:38:01.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63662024-11-27T18:38:01.847ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
63672024-11-27T18:38:01.847ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f969fed-0c2a-4a17-8be6-43f945a19c87", "content-length": "2", "date": "Wed, 27 Nov 2024 18:38:00 GMT"} })
63682024-11-27T18:38:01.847ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
63692024-11-27T18:38:01.847ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "04057ad1-1d11-4d14-913a-0dcc8c55213f", "content-length": "52", "date": "Wed, 27 Nov 2024 18:38:00 GMT"} })
63702024-11-27T18:38:01.847ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
63712024-11-27T18:38:01.847ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
63722024-11-27T18:38:01.847ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
63732024-11-27T18:38:01.847ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
63742024-11-27T18:38:01.863ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0c37bde3-b542-418f-a996-6ed504604827", "date": "Wed, 27 Nov 2024 18:38:01 GMT"} })
63752024-11-27T18:38:01.863ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63762024-11-27T18:38:01.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63772024-11-27T18:38:01.864ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "adac29e9-b100-4d84-b98d-d3279700bbf7", "content-length": "691", "date": "Wed, 27 Nov 2024 18:38:01 GMT"} })
63782024-11-27T18:38:01.864ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
63792024-11-27T18:38:01.864ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
63802024-11-27T18:38:01.864ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
63812024-11-27T18:38:01.865ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 290.344143ms iteration = 8 status = {}
63822024-11-27T18:38:01.865ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63832024-11-27T18:38:01.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63842024-11-27T18:38:01.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63852024-11-27T18:38:01.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63862024-11-27T18:38:01.871ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
63872024-11-27T18:38:01.871ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
63882024-11-27T18:38:01.873ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "06ac4e5a-7050-43eb-ab72-fd470db95351", "date": "Wed, 27 Nov 2024 18:38:01 GMT"} })
63892024-11-27T18:38:01.875ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 300.566115ms iteration = 9 status = {}
63902024-11-27T18:38:01.960ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2ab2e4c1-7dab-43e0-8c2c-fb04e292e9ff", "date": "Wed, 27 Nov 2024 18:38:01 GMT"} })
63912024-11-27T18:38:01.960ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
63922024-11-27T18:38:01.960ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
63932024-11-27T18:38:01.961ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1afe1414-7d16-4b88-8f78-3ff9e14934aa", "content-length": "682", "date": "Wed, 27 Nov 2024 18:38:01 GMT"} })
63942024-11-27T18:38:01.961ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63952024-11-27T18:38:01.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63962024-11-27T18:38:01.965ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63972024-11-27T18:38:01.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63982024-11-27T18:38:01.970ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63992024-11-27T18:38:01.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64002024-11-27T18:38:01.972ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64012024-11-27T18:38:01.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64022024-11-27T18:38:01.982ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 407.123744ms iteration = 8 status = {}
64032024-11-27T18:38:08.742ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1266 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = e8c9f69d-c9d7-4a89-8669-5d0269c719e8 response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
64042024-11-27T18:38:11.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
64052024-11-27T18:38:11.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
64062024-11-27T18:38:11.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64072024-11-27T18:38:11.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64082024-11-27T18:38:11.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64092024-11-27T18:38:11.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64102024-11-27T18:38:11.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64112024-11-27T18:38:11.577ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64122024-11-27T18:38:11.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64132024-11-27T18:38:11.579ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.420386ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64142024-11-27T18:38:11.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64152024-11-27T18:38:11.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64162024-11-27T18:38:11.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64172024-11-27T18:38:11.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64182024-11-27T18:38:11.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64192024-11-27T18:38:11.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64202024-11-27T18:38:11.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
64212024-11-27T18:38:11.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64222024-11-27T18:38:11.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64232024-11-27T18:38:11.599ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
64242024-11-27T18:38:11.599ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.849639ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
64252024-11-27T18:38:18.333ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:46265
64262024-11-27T18:38:18.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46265 req_id = f274c8bc-bdb5-43d2-adda-9ae59b636781 roles = RoleSet { roles: {} } uri = /metrics/producers
64272024-11-27T18:38:18.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46265 req_id = f274c8bc-bdb5-43d2-adda-9ae59b636781 resource = Database result = Ok(()) uri = /metrics/producers
64282024-11-27T18:38:18.342ZINFOnexus: assigned collector to new producer collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:76 producer_id = d7cc4ac1-6d92-4a20-8b63-97d7517b1cd5
64292024-11-27T18:38:18.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9420 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46265 req_id = f274c8bc-bdb5-43d2-adda-9ae59b636781 response_code = 201 uri = /metrics/producers
64302024-11-27T18:38:18.742ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1603 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = c7c119f2-e40c-45c7-aefd-05abb50e047f response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
64312024-11-27T18:38:21.575ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
64322024-11-27T18:38:21.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
64332024-11-27T18:38:21.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64342024-11-27T18:38:21.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64352024-11-27T18:38:21.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64362024-11-27T18:38:21.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64372024-11-27T18:38:21.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64382024-11-27T18:38:21.578ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64392024-11-27T18:38:21.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64402024-11-27T18:38:21.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64412024-11-27T18:38:21.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64422024-11-27T18:38:21.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64432024-11-27T18:38:21.580ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.170286ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64442024-11-27T18:38:21.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64452024-11-27T18:38:21.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64462024-11-27T18:38:21.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64472024-11-27T18:38:21.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
64482024-11-27T18:38:21.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64492024-11-27T18:38:21.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64502024-11-27T18:38:21.594ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
64512024-11-27T18:38:21.594ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.365387ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
64522024-11-27T18:38:28.742ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1058 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 57d13bbf-faf9-4161-98a7-db6c14331267 response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
64532024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
64542024-11-27T18:38:31.575ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 4ce244bc-1034-4855-877d-76a08bc15b71
64552024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 23.101\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"4ce244bc-1034-4855-877d-76a08bc15b71"}
64562024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
64572024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
64582024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
64592024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
64602024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64612024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
64622024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
64632024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
64642024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
64652024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
64662024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
64672024-11-27T18:38:31.575ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-27 18:28:31.575306254 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
64682024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
64692024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64702024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
64712024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
64722024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
64732024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
64742024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64752024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
64762024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
64772024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
64782024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
64792024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
64802024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
64812024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
64822024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64832024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
64842024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
64852024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
64862024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
64872024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64882024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
64892024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
64902024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64912024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
64922024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
64932024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
64942024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
64952024-11-27T18:38:31.575ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
64962024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64972024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64982024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
64992024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
65002024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
65012024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
65022024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
65032024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
65042024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
65052024-11-27T18:38:31.575ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
65062024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
65072024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
65082024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65092024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
65102024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
65112024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
65122024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
65132024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
65142024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
65152024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65162024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65172024-11-27T18:38:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65182024-11-27T18:38:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
65192024-11-27T18:38:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
65202024-11-27T18:38:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65212024-11-27T18:38:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
65222024-11-27T18:38:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
65232024-11-27T18:38:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65242024-11-27T18:38:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65252024-11-27T18:38:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
65262024-11-27T18:38:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65272024-11-27T18:38:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65282024-11-27T18:38:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
65292024-11-27T18:38:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
65302024-11-27T18:38:31.576ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("923a7051-0539-4413-bab4-c2b0d3395fe2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2345, tv_nsec: 573760174 } })
65312024-11-27T18:38:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
65322024-11-27T18:38:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
65332024-11-27T18:38:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
65342024-11-27T18:38:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65352024-11-27T18:38:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
65362024-11-27T18:38:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65372024-11-27T18:38:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
65382024-11-27T18:38:31.576ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f378a24-7578-4d72-8454-f489a3e51ffb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e203eafc-5cbd-4249-8d8a-770878ed4d6d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 2345, tv_nsec: 573815854 } })
65392024-11-27T18:38:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
65402024-11-27T18:38:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
65412024-11-27T18:38:31.576ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
65422024-11-27T18:38:31.576ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.402731ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
65432024-11-27T18:38:31.576ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
65442024-11-27T18:38:31.576ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.572343ms iteration = 6 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
65452024-11-27T18:38:31.578ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65462024-11-27T18:38:31.578ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.34443ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
65472024-11-27T18:38:31.579ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
65482024-11-27T18:38:31.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65492024-11-27T18:38:31.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
65502024-11-27T18:38:31.580ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
65512024-11-27T18:38:31.580ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
65522024-11-27T18:38:31.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65532024-11-27T18:38:31.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65542024-11-27T18:38:31.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65552024-11-27T18:38:31.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65562024-11-27T18:38:31.582ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-27 18:28:31.575306254 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
65572024-11-27T18:38:31.582ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 7.40177ms iteration = 5 status = {"expiration":"2024-11-27T18:28:31.575306254Z","pruned":[]}
65582024-11-27T18:38:31.584ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
65592024-11-27T18:38:31.584ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65602024-11-27T18:38:31.584ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65612024-11-27T18:38:31.584ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2345, tv_nsec: 582194499 } })
65622024-11-27T18:38:31.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
65632024-11-27T18:38:31.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65642024-11-27T18:38:31.584ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
65652024-11-27T18:38:31.586ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65662024-11-27T18:38:31.586ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
65672024-11-27T18:38:31.586ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
65682024-11-27T18:38:31.586ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65692024-11-27T18:38:31.586ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65702024-11-27T18:38:31.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65712024-11-27T18:38:31.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
65722024-11-27T18:38:31.587ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65732024-11-27T18:38:31.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65742024-11-27T18:38:31.588ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2345, tv_nsec: 585868773 } })
65752024-11-27T18:38:31.588ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
65762024-11-27T18:38:31.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
65772024-11-27T18:38:31.589ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
65782024-11-27T18:38:31.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
65792024-11-27T18:38:31.589ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65802024-11-27T18:38:31.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
65812024-11-27T18:38:31.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65822024-11-27T18:38:31.590ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
65832024-11-27T18:38:31.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
65842024-11-27T18:38:31.590ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65852024-11-27T18:38:31.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65862024-11-27T18:38:31.592ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65872024-11-27T18:38:31.592ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65882024-11-27T18:38:31.592ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65892024-11-27T18:38:31.592ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 17.249066ms iteration = 9 status = {"errors":[],"records_set_to_done":[]}
65902024-11-27T18:38:31.594ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 19.040062ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
65912024-11-27T18:38:31.594ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
65922024-11-27T18:38:31.594ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65932024-11-27T18:38:31.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65942024-11-27T18:38:31.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
65952024-11-27T18:38:31.595ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
65962024-11-27T18:38:31.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
65972024-11-27T18:38:31.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
65982024-11-27T18:38:31.596ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65992024-11-27T18:38:31.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66002024-11-27T18:38:31.597ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 21.709181ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
66012024-11-27T18:38:31.598ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66022024-11-27T18:38:31.598ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66032024-11-27T18:38:31.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66042024-11-27T18:38:31.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66052024-11-27T18:38:31.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66062024-11-27T18:38:31.601ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
66072024-11-27T18:38:31.601ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2345, tv_nsec: 599584086 } })
66082024-11-27T18:38:31.602ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
66092024-11-27T18:38:31.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66102024-11-27T18:38:31.603ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66112024-11-27T18:38:31.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66122024-11-27T18:38:31.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
66132024-11-27T18:38:31.618ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66142024-11-27T18:38:31.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66152024-11-27T18:38:31.620ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66162024-11-27T18:38:31.620ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66172024-11-27T18:38:31.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
66182024-11-27T18:38:31.624ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66192024-11-27T18:38:31.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66202024-11-27T18:38:31.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
66212024-11-27T18:38:31.624ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66222024-11-27T18:38:31.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66232024-11-27T18:38:31.636ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
66242024-11-27T18:38:31.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
66252024-11-27T18:38:31.638ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 62.709179ms iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
66262024-11-27T18:38:31.638ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66272024-11-27T18:38:31.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66282024-11-27T18:38:31.639ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66292024-11-27T18:38:31.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66302024-11-27T18:38:31.641ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
66312024-11-27T18:38:31.641ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
66322024-11-27T18:38:31.641ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 66.586327ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
66332024-11-27T18:38:31.646ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
66342024-11-27T18:38:31.646ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 71.050883ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
66352024-11-27T18:38:31.646ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66362024-11-27T18:38:31.646ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
66372024-11-27T18:38:31.646ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66382024-11-27T18:38:31.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66392024-11-27T18:38:31.650ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
66402024-11-27T18:38:31.650ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
66412024-11-27T18:38:31.650ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
66422024-11-27T18:38:31.650ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66432024-11-27T18:38:31.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66442024-11-27T18:38:31.654ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
66452024-11-27T18:38:31.654ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
66462024-11-27T18:38:31.654ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
66472024-11-27T18:38:31.654ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66482024-11-27T18:38:31.654ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66492024-11-27T18:38:31.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66502024-11-27T18:38:31.655ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66512024-11-27T18:38:31.655ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 80.226449ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66522024-11-27T18:38:31.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66532024-11-27T18:38:31.658ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
66542024-11-27T18:38:31.658ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
66552024-11-27T18:38:31.658ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 82.684716ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
66562024-11-27T18:38:31.658ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66572024-11-27T18:38:31.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66582024-11-27T18:38:31.658ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66592024-11-27T18:38:31.659ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
66602024-11-27T18:38:31.659ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66612024-11-27T18:38:31.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66622024-11-27T18:38:31.659ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66632024-11-27T18:38:31.661ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
66642024-11-27T18:38:31.661ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66652024-11-27T18:38:31.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66662024-11-27T18:38:31.663ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
66672024-11-27T18:38:31.663ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66682024-11-27T18:38:31.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66692024-11-27T18:38:31.664ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66702024-11-27T18:38:31.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66712024-11-27T18:38:31.666ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66722024-11-27T18:38:31.666ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66732024-11-27T18:38:31.667ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66742024-11-27T18:38:31.668ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 93.400264ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
66752024-11-27T18:38:31.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
66762024-11-27T18:38:31.669ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66772024-11-27T18:38:31.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66782024-11-27T18:38:31.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
66792024-11-27T18:38:31.669ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66802024-11-27T18:38:31.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66812024-11-27T18:38:31.670ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
66822024-11-27T18:38:31.670ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66832024-11-27T18:38:31.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66842024-11-27T18:38:31.672ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 96.45296ms iteration = 9 status = 0
66852024-11-27T18:38:31.675ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 100.156475ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
66862024-11-27T18:38:31.676ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
66872024-11-27T18:38:31.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
66882024-11-27T18:38:31.692ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66892024-11-27T18:38:31.692ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
66902024-11-27T18:38:31.692ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 117.139526ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
66912024-11-27T18:38:31.698ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
66922024-11-27T18:38:31.698ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
66932024-11-27T18:38:31.698ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66942024-11-27T18:38:31.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66952024-11-27T18:38:31.702ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
66962024-11-27T18:38:31.702ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 0 version = 2
66972024-11-27T18:38:31.702ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66982024-11-27T18:38:31.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66992024-11-27T18:38:31.707ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
67002024-11-27T18:38:31.728ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67012024-11-27T18:38:31.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67022024-11-27T18:38:31.739ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
67032024-11-27T18:38:31.739ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67042024-11-27T18:38:31.739ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "96933713-7647-4d57-973a-eeda2bf5da1a", "content-length": "26", "date": "Wed, 27 Nov 2024 18:38:31 GMT"} })
67052024-11-27T18:38:31.739ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67062024-11-27T18:38:31.741ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
67072024-11-27T18:38:31.775ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
67082024-11-27T18:38:31.775ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 200.057824ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
67092024-11-27T18:38:31.776ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
67102024-11-27T18:38:31.776ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67112024-11-27T18:38:31.776ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4648be2-f59b-4826-b106-a5eede0bfafe", "content-length": "26", "date": "Wed, 27 Nov 2024 18:38:31 GMT"} })
67122024-11-27T18:38:31.776ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67132024-11-27T18:38:31.778ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
67142024-11-27T18:38:31.797ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
67152024-11-27T18:38:31.844ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
67162024-11-27T18:38:31.844ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
67172024-11-27T18:38:31.845ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "622024d0-b15e-4a3c-8174-e1b53da8339a", "content-length": "372", "date": "Wed, 27 Nov 2024 18:38:31 GMT"} })
67182024-11-27T18:38:31.845ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67192024-11-27T18:38:31.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67202024-11-27T18:38:31.847ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67212024-11-27T18:38:31.848ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67222024-11-27T18:38:31.848ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67232024-11-27T18:38:31.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
67242024-11-27T18:38:31.850ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67252024-11-27T18:38:31.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67262024-11-27T18:38:31.851ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67272024-11-27T18:38:31.851ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67282024-11-27T18:38:31.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67292024-11-27T18:38:31.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
67302024-11-27T18:38:31.852ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
67312024-11-27T18:38:31.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67322024-11-27T18:38:31.853ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
67332024-11-27T18:38:31.853ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
67342024-11-27T18:38:31.853ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-27 18:34:43.283070 UTC dns_group = internal generation = 1
67352024-11-27T18:38:31.853ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 277.793957ms iteration = 6 status = {"generation":1}
67362024-11-27T18:38:31.853ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67372024-11-27T18:38:31.854ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-27T18:34:28.564237Z, time_modified: 2024-11-27T18:34:28.564237Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }) }
67382024-11-27T18:38:31.854ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 279.292449ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]}},"default_endpoint":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
67392024-11-27T18:38:31.854ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 1 version = 2
67402024-11-27T18:38:31.854ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
67412024-11-27T18:38:31.854ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-27 18:34:44.388958 UTC dns_group = external generation = 2
67422024-11-27T18:38:31.854ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 279.318939ms iteration = 6 status = {"generation":2}
67432024-11-27T18:38:31.855ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67442024-11-27T18:38:31.855ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67452024-11-27T18:38:31.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67462024-11-27T18:38:31.887ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
67472024-11-27T18:38:31.893ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
67482024-11-27T18:38:31.893ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
67492024-11-27T18:38:31.893ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3fcf17f0-1ed5-448b-9a99-957691ba6f87", "date": "Wed, 27 Nov 2024 18:38:31 GMT"} })
67502024-11-27T18:38:31.893ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67512024-11-27T18:38:31.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67522024-11-27T18:38:31.896ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67532024-11-27T18:38:31.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67542024-11-27T18:38:31.904ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67552024-11-27T18:38:31.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67562024-11-27T18:38:31.907ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
67572024-11-27T18:38:31.907ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
67582024-11-27T18:38:31.908ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2f4e27e6-07c5-4beb-a65a-67516ae3b4a9", "date": "Wed, 27 Nov 2024 18:38:31 GMT"} })
67592024-11-27T18:38:31.909ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 334.452387ms iteration = 10 status = {}
67602024-11-27T18:38:31.913ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
67612024-11-27T18:38:31.914ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 338.473507ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
67622024-11-27T18:38:31.932ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
67632024-11-27T18:38:31.932ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67642024-11-27T18:38:31.932ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b93c32b-1d03-45de-bcb5-619e12dec4d4", "content-length": "26", "date": "Wed, 27 Nov 2024 18:38:31 GMT"} })
67652024-11-27T18:38:31.932ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67662024-11-27T18:38:31.934ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
67672024-11-27T18:38:31.937ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 361.762312ms iteration = 9 status = {}
67682024-11-27T18:38:31.943ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 368.293708ms iteration = 11 status = {"physical_disks_added":0}
67692024-11-27T18:38:31.984ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
67702024-11-27T18:38:31.985ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "30cc037c-4c13-4175-a555-b15b8434010b", "content-length": "1", "date": "Wed, 27 Nov 2024 18:38:31 GMT"} })
67712024-11-27T18:38:31.987ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
67722024-11-27T18:38:31.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
67732024-11-27T18:38:32.005ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
67742024-11-27T18:38:32.006ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "d84d033b-d5a2-4d35-b2f6-d9c0816ce230", "date": "Wed, 27 Nov 2024 18:38:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
67752024-11-27T18:38:32.006ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
67762024-11-27T18:38:32.008ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "9c0e8b46-6c6f-4daf-be45-b0d445371014", "date": "Wed, 27 Nov 2024 18:38:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
67772024-11-27T18:38:32.008ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
67782024-11-27T18:38:32.010ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
67792024-11-27T18:38:32.010ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 435.544375ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
67802024-11-27T18:38:32.028ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
67812024-11-27T18:38:32.029ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "9cf82f88-0d6d-4d74-83db-f8b5b9f19093", "date": "Wed, 27 Nov 2024 18:38:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
67822024-11-27T18:38:32.029ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
67832024-11-27T18:38:32.031ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "619f9a14-3817-452f-91b8-d1a7ac87760b", "date": "Wed, 27 Nov 2024 18:38:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
67842024-11-27T18:38:32.031ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
67852024-11-27T18:38:32.032ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "c694f328-57fd-4830-b454-d334b9d79cf3", "date": "Wed, 27 Nov 2024 18:38:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
67862024-11-27T18:38:32.032ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
67872024-11-27T18:38:32.034ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
67882024-11-27T18:38:32.034ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 459.397308ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
67892024-11-27T18:38:32.036ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
67902024-11-27T18:38:32.038ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 462.87334ms iteration = 9 status = null
67912024-11-27T18:38:32.087ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "51cb33cc-8618-46a1-ac32-3a825aa29338", "content-length": "691", "date": "Wed, 27 Nov 2024 18:38:31 GMT"} })
67922024-11-27T18:38:32.088ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
67932024-11-27T18:38:32.088ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
67942024-11-27T18:38:32.088ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
67952024-11-27T18:38:32.089ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 514.685478ms iteration = 9 status = {}
67962024-11-27T18:38:32.110ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67972024-11-27T18:38:32.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67982024-11-27T18:38:32.112ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
67992024-11-27T18:38:32.112ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68002024-11-27T18:38:32.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68012024-11-27T18:38:32.122ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
68022024-11-27T18:38:32.122ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c6d4deb-0db1-43fa-adc0-29d3652afbe0", "content-length": "134", "date": "Wed, 27 Nov 2024 18:38:31 GMT"} })
68032024-11-27T18:38:32.122ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
68042024-11-27T18:38:32.122ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
68052024-11-27T18:38:32.122ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
68062024-11-27T18:38:32.122ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
68072024-11-27T18:38:32.122ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68082024-11-27T18:38:32.122ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68092024-11-27T18:38:32.122ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68102024-11-27T18:38:32.122ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
68112024-11-27T18:38:32.123ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68122024-11-27T18:38:32.123ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
68132024-11-27T18:38:32.123ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
68142024-11-27T18:38:32.123ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68152024-11-27T18:38:32.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68162024-11-27T18:38:32.125ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
68172024-11-27T18:38:32.125ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb57a52f-a4a6-46a7-ae13-e6fc07174bee", "content-length": "2", "date": "Wed, 27 Nov 2024 18:38:31 GMT"} })
68182024-11-27T18:38:32.125ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
68192024-11-27T18:38:32.125ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f039f92-8355-4905-afe3-161256dabc5e", "content-length": "52", "date": "Wed, 27 Nov 2024 18:38:31 GMT"} })
68202024-11-27T18:38:32.125ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
68212024-11-27T18:38:32.125ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
68222024-11-27T18:38:32.228ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "78194b80-a1eb-48ef-a450-1025c900e2b5", "date": "Wed, 27 Nov 2024 18:38:32 GMT"} })
68232024-11-27T18:38:32.228ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
68242024-11-27T18:38:32.228ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
68252024-11-27T18:38:32.228ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "412e31b5-7269-4ad6-892d-db2ac1ec150f", "content-length": "682", "date": "Wed, 27 Nov 2024 18:38:31 GMT"} })
68262024-11-27T18:38:32.228ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68272024-11-27T18:38:32.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68282024-11-27T18:38:32.232ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68292024-11-27T18:38:32.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68302024-11-27T18:38:32.235ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68312024-11-27T18:38:32.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68322024-11-27T18:38:32.237ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68332024-11-27T18:38:32.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68342024-11-27T18:38:32.244ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 669.269669ms iteration = 9 status = {}
68352024-11-27T18:38:38.741ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1012 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 71bf3ab7-8748-46ca-beb3-4465af5a92f4 response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
68362024-11-27T18:38:41.575ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
68372024-11-27T18:38:41.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
68382024-11-27T18:38:41.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68392024-11-27T18:38:41.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68402024-11-27T18:38:41.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68412024-11-27T18:38:41.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68422024-11-27T18:38:41.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68432024-11-27T18:38:41.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68442024-11-27T18:38:41.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68452024-11-27T18:38:41.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68462024-11-27T18:38:41.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68472024-11-27T18:38:41.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68482024-11-27T18:38:41.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68492024-11-27T18:38:41.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
68502024-11-27T18:38:41.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68512024-11-27T18:38:41.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68522024-11-27T18:38:41.601ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
68532024-11-27T18:38:41.601ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.411362ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
68542024-11-27T18:38:41.610ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68552024-11-27T18:38:41.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68562024-11-27T18:38:41.638ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.680154ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68572024-11-27T18:38:48.742ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1573 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 740d8fdc-343e-4dc5-82d8-3381762bccf6 response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
68582024-11-27T18:38:51.575ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
68592024-11-27T18:38:51.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
68602024-11-27T18:38:51.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68612024-11-27T18:38:51.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68622024-11-27T18:38:51.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68632024-11-27T18:38:51.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68642024-11-27T18:38:51.577ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68652024-11-27T18:38:51.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68662024-11-27T18:38:51.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68672024-11-27T18:38:51.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68682024-11-27T18:38:51.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68692024-11-27T18:38:51.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68702024-11-27T18:38:51.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68712024-11-27T18:38:51.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68722024-11-27T18:38:51.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68732024-11-27T18:38:51.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
68742024-11-27T18:38:51.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68752024-11-27T18:38:51.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68762024-11-27T18:38:51.599ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
68772024-11-27T18:38:51.599ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.733437ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
68782024-11-27T18:38:51.605ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.113276ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68792024-11-27T18:38:58.572ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:48635
68802024-11-27T18:38:58.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = fb46c122-eb55-437b-925a-0c68b3554d63 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
68812024-11-27T18:38:58.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = fb46c122-eb55-437b-925a-0c68b3554d63 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
68822024-11-27T18:38:58.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2975 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = fb46c122-eb55-437b-925a-0c68b3554d63 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
68832024-11-27T18:38:58.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 09439da6-caae-4cda-ac87-43b056ed77de roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
68842024-11-27T18:38:58.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 09439da6-caae-4cda-ac87-43b056ed77de resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
68852024-11-27T18:38:58.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2633 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 09439da6-caae-4cda-ac87-43b056ed77de response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
68862024-11-27T18:38:58.742ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 979 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 59585a8a-b89a-4a6c-a0ff-50416ec99deb response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
68872024-11-27T18:39:01.575ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
68882024-11-27T18:39:01.575ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
68892024-11-27T18:39:01.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68902024-11-27T18:39:01.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
68912024-11-27T18:39:01.575ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68922024-11-27T18:39:01.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
68932024-11-27T18:39:01.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68942024-11-27T18:39:01.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
68952024-11-27T18:39:01.575ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
68962024-11-27T18:39:01.575ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
68972024-11-27T18:39:01.575ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
68982024-11-27T18:39:01.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68992024-11-27T18:39:01.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
69002024-11-27T18:39:01.575ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69012024-11-27T18:39:01.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
69022024-11-27T18:39:01.575ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
69032024-11-27T18:39:01.575ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
69042024-11-27T18:39:01.575ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
69052024-11-27T18:39:01.575ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
69062024-11-27T18:39:01.575ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
69072024-11-27T18:39:01.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
69082024-11-27T18:39:01.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69092024-11-27T18:39:01.575ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
69102024-11-27T18:39:01.575ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
69112024-11-27T18:39:01.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
69122024-11-27T18:39:01.575ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
69132024-11-27T18:39:01.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
69142024-11-27T18:39:01.575ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
69152024-11-27T18:39:01.575ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69162024-11-27T18:39:01.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
69172024-11-27T18:39:01.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
69182024-11-27T18:39:01.575ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
69192024-11-27T18:39:01.575ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
69202024-11-27T18:39:01.575ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69212024-11-27T18:39:01.575ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
69222024-11-27T18:39:01.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69232024-11-27T18:39:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69242024-11-27T18:39:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
69252024-11-27T18:39:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69262024-11-27T18:39:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
69272024-11-27T18:39:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
69282024-11-27T18:39:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
69292024-11-27T18:39:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
69302024-11-27T18:39:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69312024-11-27T18:39:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69322024-11-27T18:39:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
69332024-11-27T18:39:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69342024-11-27T18:39:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
69352024-11-27T18:39:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
69362024-11-27T18:39:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
69372024-11-27T18:39:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69382024-11-27T18:39:01.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69392024-11-27T18:39:01.578ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69402024-11-27T18:39:01.579ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69412024-11-27T18:39:01.579ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.242613ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
69422024-11-27T18:39:01.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69432024-11-27T18:39:01.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
69442024-11-27T18:39:01.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69452024-11-27T18:39:01.581ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69462024-11-27T18:39:01.581ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
69472024-11-27T18:39:01.581ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69482024-11-27T18:39:01.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69492024-11-27T18:39:01.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69502024-11-27T18:39:01.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69512024-11-27T18:39:01.584ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2375, tv_nsec: 581489048 } })
69522024-11-27T18:39:01.584ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
69532024-11-27T18:39:01.584ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2375, tv_nsec: 582105117 } })
69542024-11-27T18:39:01.584ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
69552024-11-27T18:39:01.585ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69562024-11-27T18:39:01.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
69572024-11-27T18:39:01.586ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69582024-11-27T18:39:01.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69592024-11-27T18:39:01.589ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69602024-11-27T18:39:01.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69612024-11-27T18:39:01.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69622024-11-27T18:39:01.593ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
69632024-11-27T18:39:01.593ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69642024-11-27T18:39:01.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69652024-11-27T18:39:01.595ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
69662024-11-27T18:39:01.595ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
69672024-11-27T18:39:01.595ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
69682024-11-27T18:39:01.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
69692024-11-27T18:39:01.595ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69702024-11-27T18:39:01.596ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69712024-11-27T18:39:01.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69722024-11-27T18:39:01.596ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69732024-11-27T18:39:01.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69742024-11-27T18:39:01.596ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2375, tv_nsec: 594410150 } })
69752024-11-27T18:39:01.597ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
69762024-11-27T18:39:01.598ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69772024-11-27T18:39:01.600ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
69782024-11-27T18:39:01.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69792024-11-27T18:39:01.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69802024-11-27T18:39:01.600ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
69812024-11-27T18:39:01.600ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69822024-11-27T18:39:01.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69832024-11-27T18:39:01.617ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
69842024-11-27T18:39:01.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
69852024-11-27T18:39:01.620ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
69862024-11-27T18:39:01.620ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 45.20818ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
69872024-11-27T18:39:01.621ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69882024-11-27T18:39:01.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69892024-11-27T18:39:01.622ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 46.725933ms iteration = 10 status = {"errors":[],"records_set_to_done":[]}
69902024-11-27T18:39:01.624ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69912024-11-27T18:39:01.624ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69922024-11-27T18:39:01.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69932024-11-27T18:39:01.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69942024-11-27T18:39:01.624ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
69952024-11-27T18:39:01.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
69962024-11-27T18:39:01.627ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69972024-11-27T18:39:01.630ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
69982024-11-27T18:39:01.630ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
69992024-11-27T18:39:01.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
70002024-11-27T18:39:01.633ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 58.206513ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
70012024-11-27T18:39:01.643ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
70022024-11-27T18:39:01.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
70032024-11-27T18:39:01.646ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70042024-11-27T18:39:01.647ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 72.19514ms iteration = 12 status = {"physical_disks_added":0}
70052024-11-27T18:39:01.649ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
70062024-11-27T18:39:01.649ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70072024-11-27T18:39:01.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70082024-11-27T18:39:01.651ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 76.113109ms iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
70092024-11-27T18:39:01.652ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70102024-11-27T18:39:01.652ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
70112024-11-27T18:39:01.652ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70122024-11-27T18:39:01.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70132024-11-27T18:39:01.655ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70142024-11-27T18:39:01.656ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
70152024-11-27T18:39:01.656ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70162024-11-27T18:39:01.656ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f72e5aa6-6f28-4a5e-ae0a-00e755424885", "content-length": "26", "date": "Wed, 27 Nov 2024 18:39:01 GMT"} })
70172024-11-27T18:39:01.656ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70182024-11-27T18:39:01.659ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
70192024-11-27T18:39:01.659ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70202024-11-27T18:39:01.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70212024-11-27T18:39:01.659ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
70222024-11-27T18:39:01.659ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70232024-11-27T18:39:01.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70242024-11-27T18:39:01.661ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 85.526488ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70252024-11-27T18:39:01.669ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
70262024-11-27T18:39:01.669ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70272024-11-27T18:39:01.669ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "05aeafac-7c46-4f4c-9aa2-1a7c6d29e63b", "content-length": "26", "date": "Wed, 27 Nov 2024 18:39:01 GMT"} })
70282024-11-27T18:39:01.669ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70292024-11-27T18:39:01.671ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
70302024-11-27T18:39:01.675ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 99.79681ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
70312024-11-27T18:39:01.682ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
70322024-11-27T18:39:01.682ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 107.224139ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
70332024-11-27T18:39:01.684ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
70342024-11-27T18:39:01.684ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70352024-11-27T18:39:01.684ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c49a8484-0316-46b7-9c41-cf6a5e0d4b37", "content-length": "26", "date": "Wed, 27 Nov 2024 18:39:01 GMT"} })
70362024-11-27T18:39:01.685ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70372024-11-27T18:39:01.686ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
70382024-11-27T18:39:01.712ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70392024-11-27T18:39:01.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70402024-11-27T18:39:01.745ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
70412024-11-27T18:39:01.745ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
70422024-11-27T18:39:01.748ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 172.884532ms iteration = 10 status = 0
70432024-11-27T18:39:01.755ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
70442024-11-27T18:39:01.755ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "887ad69a-2b04-4532-90b3-e551a0bf21be", "content-length": "1", "date": "Wed, 27 Nov 2024 18:39:01 GMT"} })
70452024-11-27T18:39:01.757ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
70462024-11-27T18:39:01.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
70472024-11-27T18:39:01.759ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 184.193319ms iteration = 10 status = null
70482024-11-27T18:39:01.763ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 187.601839ms iteration = 10 status = {}
70492024-11-27T18:39:01.769ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70502024-11-27T18:39:01.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70512024-11-27T18:39:01.770ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70522024-11-27T18:39:01.772ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
70532024-11-27T18:39:01.772ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70542024-11-27T18:39:01.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70552024-11-27T18:39:01.774ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70562024-11-27T18:39:01.776ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
70572024-11-27T18:39:01.776ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70582024-11-27T18:39:01.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70592024-11-27T18:39:01.781ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 205.666188ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
70602024-11-27T18:39:01.789ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70612024-11-27T18:39:01.789ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
70622024-11-27T18:39:01.789ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 214.251874ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
70632024-11-27T18:39:01.808ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0aff4ace-9894-484b-8b02-c32a0892fe7b", "content-length": "372", "date": "Wed, 27 Nov 2024 18:39:01 GMT"} })
70642024-11-27T18:39:01.808ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70652024-11-27T18:39:01.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70662024-11-27T18:39:01.828ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70672024-11-27T18:39:01.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70682024-11-27T18:39:01.830ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
70692024-11-27T18:39:01.830ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70702024-11-27T18:39:01.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70712024-11-27T18:39:01.837ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
70722024-11-27T18:39:01.838ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "67a598ca-f5ee-4b3b-95e5-4ce93533e59c", "content-length": "134", "date": "Wed, 27 Nov 2024 18:39:01 GMT"} })
70732024-11-27T18:39:01.838ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
70742024-11-27T18:39:01.838ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
70752024-11-27T18:39:01.838ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
70762024-11-27T18:39:01.838ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
70772024-11-27T18:39:01.838ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70782024-11-27T18:39:01.838ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70792024-11-27T18:39:01.838ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70802024-11-27T18:39:01.838ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
70812024-11-27T18:39:01.838ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70822024-11-27T18:39:01.838ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
70832024-11-27T18:39:01.838ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
70842024-11-27T18:39:01.838ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70852024-11-27T18:39:01.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70862024-11-27T18:39:01.851ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
70872024-11-27T18:39:01.851ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
70882024-11-27T18:39:01.851ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2b938601-8f62-456f-97af-b9c4af63e05d", "date": "Wed, 27 Nov 2024 18:39:01 GMT"} })
70892024-11-27T18:39:01.851ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70902024-11-27T18:39:01.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70912024-11-27T18:39:01.858ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
70922024-11-27T18:39:01.859ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4cddaab9-9359-4277-958e-3f93bdaa251d", "content-length": "691", "date": "Wed, 27 Nov 2024 18:39:01 GMT"} })
70932024-11-27T18:39:01.859ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
70942024-11-27T18:39:01.859ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
70952024-11-27T18:39:01.859ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
70962024-11-27T18:39:01.860ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 284.431025ms iteration = 10 status = {}
70972024-11-27T18:39:01.860ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70982024-11-27T18:39:01.860ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
70992024-11-27T18:39:01.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71002024-11-27T18:39:01.861ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "20743ea0-2e62-4333-8cd4-779e986960f8", "content-length": "2", "date": "Wed, 27 Nov 2024 18:39:01 GMT"} })
71012024-11-27T18:39:01.861ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
71022024-11-27T18:39:01.861ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "bdac7732-bd5f-44e7-bdd5-5fe22f2f4df8", "content-length": "52", "date": "Wed, 27 Nov 2024 18:39:01 GMT"} })
71032024-11-27T18:39:01.861ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
71042024-11-27T18:39:01.861ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
71052024-11-27T18:39:01.863ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71062024-11-27T18:39:01.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71072024-11-27T18:39:01.867ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
71082024-11-27T18:39:01.867ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
71092024-11-27T18:39:01.944ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "595b62e7-2d50-4a2d-b424-997ec7405783", "date": "Wed, 27 Nov 2024 18:39:01 GMT"} })
71102024-11-27T18:39:01.944ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
71112024-11-27T18:39:01.944ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
71122024-11-27T18:39:01.945ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a26e6919-baff-4ba5-9989-a11570a543ef", "date": "Wed, 27 Nov 2024 18:39:01 GMT"} })
71132024-11-27T18:39:01.946ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 371.311273ms iteration = 11 status = {}
71142024-11-27T18:39:01.946ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "427e3057-1a39-4964-8952-dcb4f46ea1bf", "content-length": "682", "date": "Wed, 27 Nov 2024 18:39:01 GMT"} })
71152024-11-27T18:39:01.946ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71162024-11-27T18:39:01.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71172024-11-27T18:39:01.950ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71182024-11-27T18:39:01.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71192024-11-27T18:39:01.954ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71202024-11-27T18:39:01.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71212024-11-27T18:39:01.956ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71222024-11-27T18:39:01.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71232024-11-27T18:39:01.963ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 387.706776ms iteration = 10 status = {}
71242024-11-27T18:39:08.741ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1183 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 6e5580fa-ca2d-4a91-824e-5f6df41770b9 response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
71252024-11-27T18:39:11.575ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
71262024-11-27T18:39:11.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
71272024-11-27T18:39:11.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71282024-11-27T18:39:11.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71292024-11-27T18:39:11.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71302024-11-27T18:39:11.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71312024-11-27T18:39:11.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71322024-11-27T18:39:11.578ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71332024-11-27T18:39:11.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71342024-11-27T18:39:11.580ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.090815ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71352024-11-27T18:39:11.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71362024-11-27T18:39:11.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71372024-11-27T18:39:11.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71382024-11-27T18:39:11.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71392024-11-27T18:39:11.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71402024-11-27T18:39:11.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71412024-11-27T18:39:11.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
71422024-11-27T18:39:11.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71432024-11-27T18:39:11.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71442024-11-27T18:39:11.597ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
71452024-11-27T18:39:11.597ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.745927ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
71462024-11-27T18:39:18.742ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1203 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 623f13b0-f81a-4732-974b-7e8d7e7b112e response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
71472024-11-27T18:39:21.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
71482024-11-27T18:39:21.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
71492024-11-27T18:39:21.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71502024-11-27T18:39:21.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71512024-11-27T18:39:21.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71522024-11-27T18:39:21.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71532024-11-27T18:39:21.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71542024-11-27T18:39:21.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71552024-11-27T18:39:21.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71562024-11-27T18:39:21.578ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.107641ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71572024-11-27T18:39:21.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71582024-11-27T18:39:21.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71592024-11-27T18:39:21.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71602024-11-27T18:39:21.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71612024-11-27T18:39:21.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71622024-11-27T18:39:21.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71632024-11-27T18:39:21.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
71642024-11-27T18:39:21.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71652024-11-27T18:39:21.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71662024-11-27T18:39:21.593ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
71672024-11-27T18:39:21.593ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.105424ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
71682024-11-27T18:39:28.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = e6382335-59b8-4961-ae0b-57a2a045ac15 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
71692024-11-27T18:39:28.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = e6382335-59b8-4961-ae0b-57a2a045ac15 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
71702024-11-27T18:39:28.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2545 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = e6382335-59b8-4961-ae0b-57a2a045ac15 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
71712024-11-27T18:39:28.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 3d508730-d9ab-44fd-b428-6427860d050f roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
71722024-11-27T18:39:28.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 3d508730-d9ab-44fd-b428-6427860d050f resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
71732024-11-27T18:39:28.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2313 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 3d508730-d9ab-44fd-b428-6427860d050f response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
71742024-11-27T18:39:28.741ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 985 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 073474a9-62a5-40f2-996a-c8a033f87dbd response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
71752024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
71762024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
71772024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
71782024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
71792024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
71802024-11-27T18:39:31.575ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 4ce244bc-1034-4855-877d-76a08bc15b71
71812024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
71822024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.3\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"4ce244bc-1034-4855-877d-76a08bc15b71"}
71832024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
71842024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
71852024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
71862024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
71872024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71882024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
71892024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
71902024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71912024-11-27T18:39:31.575ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-27 18:29:31.575157917 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
71922024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
71932024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
71942024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
71952024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
71962024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
71972024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71982024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
71992024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
72002024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72012024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
72022024-11-27T18:39:31.575ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
72032024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
72042024-11-27T18:39:31.575ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
72052024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
72062024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72072024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
72082024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
72092024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
72102024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
72112024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72122024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
72132024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
72142024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
72152024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72162024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
72172024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
72182024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72192024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
72202024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72212024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
72222024-11-27T18:39:31.575ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
72232024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72242024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
72252024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
72262024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
72272024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
72282024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
72292024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
72302024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
72312024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
72322024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
72332024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
72342024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
72352024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72362024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
72372024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
72382024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
72392024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72402024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
72412024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72422024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
72432024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
72442024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
72452024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72462024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72472024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
72482024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72492024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72502024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
72512024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72522024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72532024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
72542024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
72552024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
72562024-11-27T18:39:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
72572024-11-27T18:39:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72582024-11-27T18:39:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72592024-11-27T18:39:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
72602024-11-27T18:39:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72612024-11-27T18:39:31.576ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("923a7051-0539-4413-bab4-c2b0d3395fe2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2405, tv_nsec: 573279516 } })
72622024-11-27T18:39:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
72632024-11-27T18:39:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72642024-11-27T18:39:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
72652024-11-27T18:39:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
72662024-11-27T18:39:31.576ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f378a24-7578-4d72-8454-f489a3e51ffb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e203eafc-5cbd-4249-8d8a-770878ed4d6d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 2405, tv_nsec: 573340757 } })
72672024-11-27T18:39:31.576ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
72682024-11-27T18:39:31.576ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.019925ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
72692024-11-27T18:39:31.576ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
72702024-11-27T18:39:31.576ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.105807ms iteration = 7 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
72712024-11-27T18:39:31.578ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.204738ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
72722024-11-27T18:39:31.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72732024-11-27T18:39:31.578ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72742024-11-27T18:39:31.578ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72752024-11-27T18:39:31.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72762024-11-27T18:39:31.579ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-27 18:29:31.575157917 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
72772024-11-27T18:39:31.579ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.05322ms iteration = 6 status = {"expiration":"2024-11-27T18:29:31.575157917Z","pruned":[]}
72782024-11-27T18:39:31.580ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
72792024-11-27T18:39:31.580ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
72802024-11-27T18:39:31.580ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 4.901432ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
72812024-11-27T18:39:31.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
72822024-11-27T18:39:31.581ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
72832024-11-27T18:39:31.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
72842024-11-27T18:39:31.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
72852024-11-27T18:39:31.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72862024-11-27T18:39:31.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72872024-11-27T18:39:31.584ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72882024-11-27T18:39:31.585ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72892024-11-27T18:39:31.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72902024-11-27T18:39:31.586ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.954182ms iteration = 11 status = {"errors":[],"records_set_to_done":[]}
72912024-11-27T18:39:31.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
72922024-11-27T18:39:31.587ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
72932024-11-27T18:39:31.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
72942024-11-27T18:39:31.589ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2405, tv_nsec: 586721096 } })
72952024-11-27T18:39:31.589ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72962024-11-27T18:39:31.589ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
72972024-11-27T18:39:31.589ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2405, tv_nsec: 587141482 } })
72982024-11-27T18:39:31.590ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
72992024-11-27T18:39:31.590ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 15.138925ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
73002024-11-27T18:39:31.591ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73012024-11-27T18:39:31.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
73022024-11-27T18:39:31.592ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73032024-11-27T18:39:31.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73042024-11-27T18:39:31.593ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
73052024-11-27T18:39:31.593ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73062024-11-27T18:39:31.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73072024-11-27T18:39:31.593ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
73082024-11-27T18:39:31.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73092024-11-27T18:39:31.595ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73102024-11-27T18:39:31.596ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.257095ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
73112024-11-27T18:39:31.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73122024-11-27T18:39:31.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73132024-11-27T18:39:31.597ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73142024-11-27T18:39:31.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73152024-11-27T18:39:31.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
73162024-11-27T18:39:31.599ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2405, tv_nsec: 597070419 } })
73172024-11-27T18:39:31.600ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
73182024-11-27T18:39:31.607ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73192024-11-27T18:39:31.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73202024-11-27T18:39:31.619ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
73212024-11-27T18:39:31.619ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
73222024-11-27T18:39:31.619ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73232024-11-27T18:39:31.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
73242024-11-27T18:39:31.622ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
73252024-11-27T18:39:31.622ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
73262024-11-27T18:39:31.622ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73272024-11-27T18:39:31.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
73282024-11-27T18:39:31.625ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73292024-11-27T18:39:31.628ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
73302024-11-27T18:39:31.628ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73312024-11-27T18:39:31.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73322024-11-27T18:39:31.629ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73332024-11-27T18:39:31.630ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73342024-11-27T18:39:31.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73352024-11-27T18:39:31.630ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
73362024-11-27T18:39:31.630ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73372024-11-27T18:39:31.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73382024-11-27T18:39:31.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
73392024-11-27T18:39:31.631ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
73402024-11-27T18:39:31.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
73412024-11-27T18:39:31.633ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
73422024-11-27T18:39:31.633ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
73432024-11-27T18:39:31.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
73442024-11-27T18:39:31.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.514472ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73452024-11-27T18:39:31.638ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
73462024-11-27T18:39:31.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
73472024-11-27T18:39:31.638ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73482024-11-27T18:39:31.639ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
73492024-11-27T18:39:31.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
73502024-11-27T18:39:31.640ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73512024-11-27T18:39:31.641ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
73522024-11-27T18:39:31.641ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73532024-11-27T18:39:31.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73542024-11-27T18:39:31.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
73552024-11-27T18:39:31.647ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73562024-11-27T18:39:31.649ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
73572024-11-27T18:39:31.649ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
73582024-11-27T18:39:31.649ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
73592024-11-27T18:39:31.649ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73602024-11-27T18:39:31.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73612024-11-27T18:39:31.649ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
73622024-11-27T18:39:31.649ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
73632024-11-27T18:39:31.649ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 74.503194ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
73642024-11-27T18:39:31.649ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73652024-11-27T18:39:31.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73662024-11-27T18:39:31.650ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
73672024-11-27T18:39:31.650ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
73682024-11-27T18:39:31.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
73692024-11-27T18:39:31.651ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73702024-11-27T18:39:31.652ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73712024-11-27T18:39:31.654ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
73722024-11-27T18:39:31.654ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73732024-11-27T18:39:31.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73742024-11-27T18:39:31.654ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73752024-11-27T18:39:31.655ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73762024-11-27T18:39:31.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73772024-11-27T18:39:31.656ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
73782024-11-27T18:39:31.656ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73792024-11-27T18:39:31.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73802024-11-27T18:39:31.656ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73812024-11-27T18:39:31.657ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
73822024-11-27T18:39:31.657ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73832024-11-27T18:39:31.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73842024-11-27T18:39:31.659ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
73852024-11-27T18:39:31.659ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73862024-11-27T18:39:31.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73872024-11-27T18:39:31.660ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
73882024-11-27T18:39:31.660ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 85.128772ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
73892024-11-27T18:39:31.661ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73902024-11-27T18:39:31.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73912024-11-27T18:39:31.663ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
73922024-11-27T18:39:31.663ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
73932024-11-27T18:39:31.663ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73942024-11-27T18:39:31.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73952024-11-27T18:39:31.665ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73962024-11-27T18:39:31.666ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73972024-11-27T18:39:31.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73982024-11-27T18:39:31.668ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73992024-11-27T18:39:31.668ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
74002024-11-27T18:39:31.668ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
74012024-11-27T18:39:31.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74022024-11-27T18:39:31.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
74032024-11-27T18:39:31.669ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
74042024-11-27T18:39:31.669ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
74052024-11-27T18:39:31.669ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 94.671844ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
74062024-11-27T18:39:31.671ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
74072024-11-27T18:39:31.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
74082024-11-27T18:39:31.672ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
74092024-11-27T18:39:31.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
74102024-11-27T18:39:31.680ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
74112024-11-27T18:39:31.680ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 105.641095ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
74122024-11-27T18:39:31.682ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 107.231899ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
74132024-11-27T18:39:31.685ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 109.924979ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
74142024-11-27T18:39:31.689ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
74152024-11-27T18:39:31.689ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
74162024-11-27T18:39:31.689ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
74172024-11-27T18:39:31.689ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
74182024-11-27T18:39:31.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
74192024-11-27T18:39:31.695ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
74202024-11-27T18:39:31.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
74212024-11-27T18:39:31.703ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74222024-11-27T18:39:31.706ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
74232024-11-27T18:39:31.706ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74242024-11-27T18:39:31.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74252024-11-27T18:39:31.713ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74262024-11-27T18:39:31.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74272024-11-27T18:39:31.758ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 183.034912ms iteration = 13 status = {"physical_disks_added":0}
74282024-11-27T18:39:31.766ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
74292024-11-27T18:39:31.766ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
74302024-11-27T18:39:31.766ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dcdec070-faed-45dd-996c-266ce5aa2b70", "content-length": "26", "date": "Wed, 27 Nov 2024 18:39:31 GMT"} })
74312024-11-27T18:39:31.766ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
74322024-11-27T18:39:31.769ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
74332024-11-27T18:39:31.825ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
74342024-11-27T18:39:31.886ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
74352024-11-27T18:39:31.907ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
74362024-11-27T18:39:31.907ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
74372024-11-27T18:39:31.908ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9cdf8f5-5c7c-4914-a5c6-54485113880e", "content-length": "372", "date": "Wed, 27 Nov 2024 18:39:31 GMT"} })
74382024-11-27T18:39:31.908ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74392024-11-27T18:39:31.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74402024-11-27T18:39:31.909ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74412024-11-27T18:39:31.911ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74422024-11-27T18:39:31.911ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
74432024-11-27T18:39:31.911ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
74442024-11-27T18:39:31.911ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-27 18:34:43.283070 UTC dns_group = internal generation = 1
74452024-11-27T18:39:31.911ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 336.376085ms iteration = 7 status = {"generation":1}
74462024-11-27T18:39:31.911ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74472024-11-27T18:39:31.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
74482024-11-27T18:39:31.912ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74492024-11-27T18:39:31.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74502024-11-27T18:39:31.914ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
74512024-11-27T18:39:31.914ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
74522024-11-27T18:39:31.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
74532024-11-27T18:39:31.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
74542024-11-27T18:39:31.915ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
74552024-11-27T18:39:31.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
74562024-11-27T18:39:31.917ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74572024-11-27T18:39:31.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74582024-11-27T18:39:31.922ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74592024-11-27T18:39:31.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74602024-11-27T18:39:31.924ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 348.814089ms iteration = 11 status = 0
74612024-11-27T18:39:31.924ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74622024-11-27T18:39:31.928ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
74632024-11-27T18:39:31.928ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74642024-11-27T18:39:31.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74652024-11-27T18:39:31.933ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74662024-11-27T18:39:31.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74672024-11-27T18:39:31.935ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74682024-11-27T18:39:31.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74692024-11-27T18:39:31.936ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
74702024-11-27T18:39:31.936ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
74712024-11-27T18:39:31.937ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ed8a517c-8406-4e3d-a0e5-0cc833215149", "date": "Wed, 27 Nov 2024 18:39:31 GMT"} })
74722024-11-27T18:39:31.937ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74732024-11-27T18:39:31.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74742024-11-27T18:39:31.938ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74752024-11-27T18:39:31.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74762024-11-27T18:39:31.939ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74772024-11-27T18:39:31.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74782024-11-27T18:39:31.940ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74792024-11-27T18:39:31.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74802024-11-27T18:39:31.941ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74812024-11-27T18:39:31.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74822024-11-27T18:39:31.942ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74832024-11-27T18:39:31.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74842024-11-27T18:39:31.944ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
74852024-11-27T18:39:31.944ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
74862024-11-27T18:39:31.944ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d3a997f-2626-426b-a40b-aa1cc1c92ac3", "content-length": "26", "date": "Wed, 27 Nov 2024 18:39:31 GMT"} })
74872024-11-27T18:39:31.944ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
74882024-11-27T18:39:31.945ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
74892024-11-27T18:39:31.945ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
74902024-11-27T18:39:31.945ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "136bf088-169d-4510-bae1-58e77812da92", "content-length": "26", "date": "Wed, 27 Nov 2024 18:39:31 GMT"} })
74912024-11-27T18:39:31.945ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
74922024-11-27T18:39:31.945ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
74932024-11-27T18:39:31.945ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
74942024-11-27T18:39:31.946ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9275e2b9-0dd2-45e6-a453-7ef9c89bc76f", "date": "Wed, 27 Nov 2024 18:39:31 GMT"} })
74952024-11-27T18:39:31.948ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
74962024-11-27T18:39:31.951ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 375.972422ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
74972024-11-27T18:39:31.952ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
74982024-11-27T18:39:31.952ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 376.586201ms iteration = 12 status = {}
74992024-11-27T18:39:31.963ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
75002024-11-27T18:39:31.963ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 0 version = 2
75012024-11-27T18:39:31.963ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75022024-11-27T18:39:31.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75032024-11-27T18:39:31.965ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75042024-11-27T18:39:31.967ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-27T18:34:28.564237Z, time_modified: 2024-11-27T18:34:28.564237Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }) }
75052024-11-27T18:39:31.967ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 392.096651ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]}},"default_endpoint":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
75062024-11-27T18:39:31.967ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
75072024-11-27T18:39:31.967ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75082024-11-27T18:39:31.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75092024-11-27T18:39:31.970ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 1 version = 2
75102024-11-27T18:39:31.970ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
75112024-11-27T18:39:31.970ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-27 18:34:44.388958 UTC dns_group = external generation = 2
75122024-11-27T18:39:31.970ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 395.262408ms iteration = 7 status = {"generation":2}
75132024-11-27T18:39:31.973ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75142024-11-27T18:39:31.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75152024-11-27T18:39:31.975ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75162024-11-27T18:39:31.980ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
75172024-11-27T18:39:31.980ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75182024-11-27T18:39:31.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75192024-11-27T18:39:31.982ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75202024-11-27T18:39:31.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75212024-11-27T18:39:31.985ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75222024-11-27T18:39:31.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75232024-11-27T18:39:31.988ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75242024-11-27T18:39:31.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75252024-11-27T18:39:31.997ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75262024-11-27T18:39:31.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75272024-11-27T18:39:32.044ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
75282024-11-27T18:39:32.044ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 469.275475ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
75292024-11-27T18:39:32.047ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75302024-11-27T18:39:32.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75312024-11-27T18:39:32.050ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75322024-11-27T18:39:32.052ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75332024-11-27T18:39:32.052ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
75342024-11-27T18:39:32.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75352024-11-27T18:39:32.052ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75362024-11-27T18:39:32.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75372024-11-27T18:39:32.055ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75382024-11-27T18:39:32.061ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
75392024-11-27T18:39:32.061ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75402024-11-27T18:39:32.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75412024-11-27T18:39:32.076ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
75422024-11-27T18:39:32.107ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75432024-11-27T18:39:32.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75442024-11-27T18:39:32.136ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
75452024-11-27T18:39:32.136ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "30f46efe-0ec9-4dd5-8436-7f5073aeef13", "content-length": "1", "date": "Wed, 27 Nov 2024 18:39:31 GMT"} })
75462024-11-27T18:39:32.138ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
75472024-11-27T18:39:32.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
75482024-11-27T18:39:32.144ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 568.693469ms iteration = 11 status = null
75492024-11-27T18:39:32.148ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75502024-11-27T18:39:32.156ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
75512024-11-27T18:39:32.156ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75522024-11-27T18:39:32.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75532024-11-27T18:39:32.192ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
75542024-11-27T18:39:32.193ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "9f9872ec-8e7b-4dfe-b095-6d78376139b9", "date": "Wed, 27 Nov 2024 18:39:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
75552024-11-27T18:39:32.193ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
75562024-11-27T18:39:32.195ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "9a62085e-dbf6-4b41-aa97-b658cbcca00d", "date": "Wed, 27 Nov 2024 18:39:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
75572024-11-27T18:39:32.195ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
75582024-11-27T18:39:32.197ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
75592024-11-27T18:39:32.197ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 621.901197ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
75602024-11-27T18:39:32.229ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 654.530341ms iteration = 11 status = {}
75612024-11-27T18:39:32.293ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75622024-11-27T18:39:32.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75632024-11-27T18:39:32.320ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
75642024-11-27T18:39:32.320ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f40b0c12-3d93-4cf8-b04e-b6801db6ea4f", "content-length": "691", "date": "Wed, 27 Nov 2024 18:39:32 GMT"} })
75652024-11-27T18:39:32.321ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
75662024-11-27T18:39:32.321ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
75672024-11-27T18:39:32.321ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
75682024-11-27T18:39:32.322ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75692024-11-27T18:39:32.322ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 747.018032ms iteration = 11 status = {}
75702024-11-27T18:39:32.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75712024-11-27T18:39:32.322ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
75722024-11-27T18:39:32.322ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
75732024-11-27T18:39:32.322ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75742024-11-27T18:39:32.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75752024-11-27T18:39:32.323ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "9ddd8450-cdc6-4a88-b50e-376f2298597a", "date": "Wed, 27 Nov 2024 18:39:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
75762024-11-27T18:39:32.323ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
75772024-11-27T18:39:32.323ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75782024-11-27T18:39:32.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75792024-11-27T18:39:32.324ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "b00ac4b3-98e9-4bad-bae2-b435a4c541e1", "date": "Wed, 27 Nov 2024 18:39:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
75802024-11-27T18:39:32.324ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
75812024-11-27T18:39:32.325ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75822024-11-27T18:39:32.325ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "33375c7a-97e2-4bd7-8544-e81417b1e323", "date": "Wed, 27 Nov 2024 18:39:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
75832024-11-27T18:39:32.325ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
75842024-11-27T18:39:32.327ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
75852024-11-27T18:39:32.327ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 752.198699ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
75862024-11-27T18:39:32.328ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
75872024-11-27T18:39:32.328ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75882024-11-27T18:39:32.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75892024-11-27T18:39:32.332ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
75902024-11-27T18:39:32.332ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3cc2a520-b45d-4a35-ac0c-17d447806b77", "content-length": "134", "date": "Wed, 27 Nov 2024 18:39:31 GMT"} })
75912024-11-27T18:39:32.333ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
75922024-11-27T18:39:32.333ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
75932024-11-27T18:39:32.333ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
75942024-11-27T18:39:32.333ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
75952024-11-27T18:39:32.333ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75962024-11-27T18:39:32.333ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75972024-11-27T18:39:32.333ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75982024-11-27T18:39:32.333ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
75992024-11-27T18:39:32.333ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76002024-11-27T18:39:32.333ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
76012024-11-27T18:39:32.333ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76022024-11-27T18:39:32.333ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
76032024-11-27T18:39:32.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76042024-11-27T18:39:32.333ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76052024-11-27T18:39:32.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76062024-11-27T18:39:32.335ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76072024-11-27T18:39:32.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76082024-11-27T18:39:32.335ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
76092024-11-27T18:39:32.336ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1c94672-a727-490e-ab8a-b5a0c1c0a865", "content-length": "2", "date": "Wed, 27 Nov 2024 18:39:31 GMT"} })
76102024-11-27T18:39:32.336ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
76112024-11-27T18:39:32.336ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "085c0d0e-f584-4cf3-8afa-2a249d125ec3", "content-length": "52", "date": "Wed, 27 Nov 2024 18:39:31 GMT"} })
76122024-11-27T18:39:32.336ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
76132024-11-27T18:39:32.336ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
76142024-11-27T18:39:32.337ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76152024-11-27T18:39:32.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76162024-11-27T18:39:32.340ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76172024-11-27T18:39:32.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76182024-11-27T18:39:32.342ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76192024-11-27T18:39:32.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76202024-11-27T18:39:32.344ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76212024-11-27T18:39:32.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76222024-11-27T18:39:32.345ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76232024-11-27T18:39:32.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76242024-11-27T18:39:32.346ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76252024-11-27T18:39:32.350ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
76262024-11-27T18:39:32.350ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76272024-11-27T18:39:32.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76282024-11-27T18:39:32.351ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76292024-11-27T18:39:32.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76302024-11-27T18:39:32.353ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76312024-11-27T18:39:32.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76322024-11-27T18:39:32.354ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76332024-11-27T18:39:32.358ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
76342024-11-27T18:39:32.358ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76352024-11-27T18:39:32.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76362024-11-27T18:39:32.364ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 2df4b43c-19b2-4d0e-9115-0713223786a3, kind: Service { id: fbc95b29-f83d-43ed-91f4-c64d49d2794a }, name: Name("nexus-fbc95b29-f83d-43ed-91f4-c64d49d2794a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 135])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 36b26f77-d20c-42ae-beb2-a2ba0a652ee7, kind: Service { id: 236c7b74-8315-46e3-9a37-90380a675558 }, name: Name("nexus-236c7b74-8315-46e3-9a37-90380a675558"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 105])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d3055ccd-84f0-4f36-b8e4-3dbd5b104332, kind: Service { id: 028a6b4a-281e-48cb-ac6a-4e4dfed5a146 }, name: Name("nexus-028a6b4a-281e-48cb-ac6a-4e4dfed5a146"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 46807e0d-b32c-46e9-ba6d-70ce0dd8f478, kind: Service { id: 923a7051-0539-4413-bab4-c2b0d3395fe2 }, name: Name("external-dns-923a7051-0539-4413-bab4-c2b0d3395fe2"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 247])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ae80547a-3043-414a-9677-e92884742152, kind: Service { id: b7585398-cabf-4150-8e11-981d1580aaf0 }, name: Name("external-dns-b7585398-cabf-4150-8e11-981d1580aaf0"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 255])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
76372024-11-27T18:39:32.364ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76382024-11-27T18:39:32.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76392024-11-27T18:39:32.365ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76402024-11-27T18:39:32.367ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
76412024-11-27T18:39:32.367ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76422024-11-27T18:39:32.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76432024-11-27T18:39:32.369ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
76442024-11-27T18:39:32.369ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 46807e0d-b32c-46e9-ba6d-70ce0dd8f478, kind: Service { id: 923a7051-0539-4413-bab4-c2b0d3395fe2 }, name: Name("external-dns-923a7051-0539-4413-bab4-c2b0d3395fe2"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 247])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ae80547a-3043-414a-9677-e92884742152, kind: Service { id: b7585398-cabf-4150-8e11-981d1580aaf0 }, name: Name("external-dns-b7585398-cabf-4150-8e11-981d1580aaf0"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 255])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 2df4b43c-19b2-4d0e-9115-0713223786a3, kind: Service { id: fbc95b29-f83d-43ed-91f4-c64d49d2794a }, name: Name("nexus-fbc95b29-f83d-43ed-91f4-c64d49d2794a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 135])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 36b26f77-d20c-42ae-beb2-a2ba0a652ee7, kind: Service { id: 236c7b74-8315-46e3-9a37-90380a675558 }, name: Name("nexus-236c7b74-8315-46e3-9a37-90380a675558"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 105])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d3055ccd-84f0-4f36-b8e4-3dbd5b104332, kind: Service { id: 028a6b4a-281e-48cb-ac6a-4e4dfed5a146 }, name: Name("nexus-028a6b4a-281e-48cb-ac6a-4e4dfed5a146"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
76452024-11-27T18:39:32.369ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
76462024-11-27T18:39:32.429ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "567d0b02-4221-4672-8a41-028b9e28d43c", "date": "Wed, 27 Nov 2024 18:39:32 GMT"} })
76472024-11-27T18:39:32.429ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
76482024-11-27T18:39:32.429ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
76492024-11-27T18:39:32.429ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "72d94fb7-5eb9-4d8c-94fc-839522b26e30", "content-length": "682", "date": "Wed, 27 Nov 2024 18:39:32 GMT"} })
76502024-11-27T18:39:32.429ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76512024-11-27T18:39:32.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76522024-11-27T18:39:32.433ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76532024-11-27T18:39:32.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76542024-11-27T18:39:32.437ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76552024-11-27T18:39:32.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76562024-11-27T18:39:32.438ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76572024-11-27T18:39:32.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76582024-11-27T18:39:32.445ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 870.100707ms iteration = 11 status = {}
76592024-11-27T18:39:32.480ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: b844cfb5-ff43-41f6-a61d-f7949f48466b, time_created: 2024-11-27T18:34:40.308972Z, time_modified: 2024-11-27T18:34:40.308972Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
76602024-11-27T18:39:32.480ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
76612024-11-27T18:39:32.480ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76622024-11-27T18:39:32.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76632024-11-27T18:39:32.482ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76642024-11-27T18:39:32.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76652024-11-27T18:39:32.483ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76662024-11-27T18:39:32.486ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
76672024-11-27T18:39:32.517ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
76682024-11-27T18:39:32.535ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "3f037f19-a65c-4ba7-8ae1-343bc09e09a0", "date": "Wed, 27 Nov 2024 18:39:31 GMT"} })
76692024-11-27T18:39:32.537ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
76702024-11-27T18:39:32.537ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 962.185692ms
76712024-11-27T18:39:32.537ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 962.194732ms iteration = 2 status = {}
76722024-11-27T18:39:36.189ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:38454
76732024-11-27T18:39:36.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38454 req_id = 744569ce-92e8-4e75-bce2-fb1727f3ef83 roles = RoleSet { roles: {} } uri = /metrics/producers
76742024-11-27T18:39:36.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38454 req_id = 744569ce-92e8-4e75-bce2-fb1727f3ef83 resource = Database result = Ok(()) uri = /metrics/producers
76752024-11-27T18:39:36.235ZINFOnexus: assigned collector to new producer collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:76 producer_id = 89a52276-2829-4963-a094-8143be2c1bad
76762024-11-27T18:39:36.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45852 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38454 req_id = 744569ce-92e8-4e75-bce2-fb1727f3ef83 response_code = 201 uri = /metrics/producers
76772024-11-27T18:39:38.741ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1064 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 854f66d8-d7b1-44f2-b6e1-ae5ebe918e2b response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
76782024-11-27T18:39:40.123ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:34988
76792024-11-27T18:39:40.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:34988 req_id = 88d0d85a-7bf6-43c4-8d40-c02df3aa383e roles = RoleSet { roles: {} } uri = /metrics/producers
76802024-11-27T18:39:40.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:34988 req_id = 88d0d85a-7bf6-43c4-8d40-c02df3aa383e resource = Database result = Ok(()) uri = /metrics/producers
76812024-11-27T18:39:40.170ZINFOnexus: assigned collector to new producer collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:76 producer_id = b903b497-e034-4c1d-8f82-b6e6cc8f7a53
76822024-11-27T18:39:40.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46845 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:34988 req_id = 88d0d85a-7bf6-43c4-8d40-c02df3aa383e response_code = 201 uri = /metrics/producers
76832024-11-27T18:39:41.575ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
76842024-11-27T18:39:41.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
76852024-11-27T18:39:41.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76862024-11-27T18:39:41.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76872024-11-27T18:39:41.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76882024-11-27T18:39:41.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76892024-11-27T18:39:41.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76902024-11-27T18:39:41.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76912024-11-27T18:39:41.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76922024-11-27T18:39:41.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76932024-11-27T18:39:41.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76942024-11-27T18:39:41.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76952024-11-27T18:39:41.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76962024-11-27T18:39:41.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
76972024-11-27T18:39:41.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76982024-11-27T18:39:41.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76992024-11-27T18:39:41.597ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
77002024-11-27T18:39:41.597ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.778473ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
77012024-11-27T18:39:41.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77022024-11-27T18:39:41.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77032024-11-27T18:39:41.630ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.27863ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77042024-11-27T18:39:43.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = a7cbd4ca-2220-43a0-bd67-b1c922ce2f13 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
77052024-11-27T18:39:43.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = a7cbd4ca-2220-43a0-bd67-b1c922ce2f13 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
77062024-11-27T18:39:43.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3323 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = a7cbd4ca-2220-43a0-bd67-b1c922ce2f13 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
77072024-11-27T18:39:43.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 386f6baf-a5f0-411e-abac-519bd6a2dc59 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
77082024-11-27T18:39:43.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 386f6baf-a5f0-411e-abac-519bd6a2dc59 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
77092024-11-27T18:39:43.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2442 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 386f6baf-a5f0-411e-abac-519bd6a2dc59 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
77102024-11-27T18:39:45.000ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
77112024-11-27T18:39:45.000ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
77122024-11-27T18:39:45.030ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
77132024-11-27T18:39:45.031ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:34691
77142024-11-27T18:39:45.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:34691 req_id = d77c9ed5-6b12-4d7c-9c58-d424f3a23e1d roles = RoleSet { roles: {} } uri = /metrics/producers
77152024-11-27T18:39:45.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:34691 req_id = d77c9ed5-6b12-4d7c-9c58-d424f3a23e1d resource = Database result = Ok(()) uri = /metrics/producers
77162024-11-27T18:39:45.051ZINFOnexus: assigned collector to new producer collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:76 producer_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
77172024-11-27T18:39:45.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 20617 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:34691 req_id = d77c9ed5-6b12-4d7c-9c58-d424f3a23e1d response_code = 201 uri = /metrics/producers
77182024-11-27T18:39:45.051ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "d77c9ed5-6b12-4d7c-9c58-d424f3a23e1d", "content-length": "41", "date": "Wed, 27 Nov 2024 18:39:45 GMT"} })
77192024-11-27T18:39:45.053ZDEBGnexus (producer-registration-task): registered with nexus successfully
77202024-11-27T18:39:45.053ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
77212024-11-27T18:39:48.741ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 993 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 8c35b8ae-d9cb-42da-b87a-e796da636d44 response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
77222024-11-27T18:39:51.575ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
77232024-11-27T18:39:51.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
77242024-11-27T18:39:51.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77252024-11-27T18:39:51.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77262024-11-27T18:39:51.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77272024-11-27T18:39:51.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77282024-11-27T18:39:51.577ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77292024-11-27T18:39:51.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77302024-11-27T18:39:51.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77312024-11-27T18:39:51.578ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.441701ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77322024-11-27T18:39:51.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77332024-11-27T18:39:51.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77342024-11-27T18:39:51.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77352024-11-27T18:39:51.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77362024-11-27T18:39:51.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77372024-11-27T18:39:51.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77382024-11-27T18:39:51.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
77392024-11-27T18:39:51.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77402024-11-27T18:39:51.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77412024-11-27T18:39:51.594ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
77422024-11-27T18:39:51.594ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.181655ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
77432024-11-27T18:39:54.094ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:62211
77442024-11-27T18:39:54.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62211 req_id = 2f0b701f-cc9d-4108-a8cc-a950d636da1c roles = RoleSet { roles: {} } uri = /metrics/producers
77452024-11-27T18:39:54.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62211 req_id = 2f0b701f-cc9d-4108-a8cc-a950d636da1c resource = Database result = Ok(()) uri = /metrics/producers
77462024-11-27T18:39:54.140ZINFOnexus: assigned collector to new producer collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:76 producer_id = 761834fc-a72f-4e26-9e1f-c4047ccf5da9
77472024-11-27T18:39:54.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46149 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62211 req_id = 2f0b701f-cc9d-4108-a8cc-a950d636da1c response_code = 201 uri = /metrics/producers
77482024-11-27T18:39:57.085ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:55193
77492024-11-27T18:39:57.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55193 req_id = 4839050c-99c6-422d-a7bb-d5a69aaf8050 roles = RoleSet { roles: {} } uri = /metrics/producers
77502024-11-27T18:39:57.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55193 req_id = 4839050c-99c6-422d-a7bb-d5a69aaf8050 resource = Database result = Ok(()) uri = /metrics/producers
77512024-11-27T18:39:57.128ZINFOnexus: assigned collector to new producer collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:76 producer_id = f3f7f234-938f-4eb4-84cd-9acd73e59924
77522024-11-27T18:39:57.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43140 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55193 req_id = 4839050c-99c6-422d-a7bb-d5a69aaf8050 response_code = 201 uri = /metrics/producers
77532024-11-27T18:39:58.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 0768a588-209d-439f-bb56-336d2a09b06d roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
77542024-11-27T18:39:58.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 0768a588-209d-439f-bb56-336d2a09b06d resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
77552024-11-27T18:39:58.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3533 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 0768a588-209d-439f-bb56-336d2a09b06d response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
77562024-11-27T18:39:58.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = c4f59d57-2a87-4a65-9a21-8f3a4244abce roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
77572024-11-27T18:39:58.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = c4f59d57-2a87-4a65-9a21-8f3a4244abce resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
77582024-11-27T18:39:58.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1980 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = c4f59d57-2a87-4a65-9a21-8f3a4244abce response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
77592024-11-27T18:39:58.742ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1448 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 9a78b775-cfd0-4c24-bbaa-9959c28834d0 response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
77602024-11-27T18:40:00.908ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:51399
77612024-11-27T18:40:00.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:51399 req_id = 7a6b6d16-4a32-4b3f-8553-b041e312ea57 roles = RoleSet { roles: {} } uri = /metrics/producers
77622024-11-27T18:40:00.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:51399 req_id = 7a6b6d16-4a32-4b3f-8553-b041e312ea57 resource = Database result = Ok(()) uri = /metrics/producers
77632024-11-27T18:40:00.921ZINFOnexus: assigned collector to new producer collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:76 producer_id = b844cfb5-ff43-41f6-a61d-f7949f48466b
77642024-11-27T18:40:00.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12260 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:51399 req_id = 7a6b6d16-4a32-4b3f-8553-b041e312ea57 response_code = 201 uri = /metrics/producers
77652024-11-27T18:40:01.575ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
77662024-11-27T18:40:01.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
77672024-11-27T18:40:01.575ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77682024-11-27T18:40:01.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
77692024-11-27T18:40:01.575ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
77702024-11-27T18:40:01.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
77712024-11-27T18:40:01.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
77722024-11-27T18:40:01.575ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77732024-11-27T18:40:01.575ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
77742024-11-27T18:40:01.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
77752024-11-27T18:40:01.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
77762024-11-27T18:40:01.575ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
77772024-11-27T18:40:01.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
77782024-11-27T18:40:01.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77792024-11-27T18:40:01.575ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
77802024-11-27T18:40:01.575ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
77812024-11-27T18:40:01.575ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
77822024-11-27T18:40:01.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
77832024-11-27T18:40:01.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
77842024-11-27T18:40:01.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
77852024-11-27T18:40:01.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
77862024-11-27T18:40:01.575ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
77872024-11-27T18:40:01.575ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77882024-11-27T18:40:01.575ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
77892024-11-27T18:40:01.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77902024-11-27T18:40:01.575ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
77912024-11-27T18:40:01.575ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
77922024-11-27T18:40:01.575ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77932024-11-27T18:40:01.575ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
77942024-11-27T18:40:01.575ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
77952024-11-27T18:40:01.575ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
77962024-11-27T18:40:01.575ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
77972024-11-27T18:40:01.575ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
77982024-11-27T18:40:01.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77992024-11-27T18:40:01.575ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78002024-11-27T18:40:01.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78012024-11-27T18:40:01.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
78022024-11-27T18:40:01.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
78032024-11-27T18:40:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78042024-11-27T18:40:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78052024-11-27T18:40:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
78062024-11-27T18:40:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
78072024-11-27T18:40:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
78082024-11-27T18:40:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
78092024-11-27T18:40:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78102024-11-27T18:40:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
78112024-11-27T18:40:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78122024-11-27T18:40:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
78132024-11-27T18:40:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78142024-11-27T18:40:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78152024-11-27T18:40:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
78162024-11-27T18:40:01.577ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78172024-11-27T18:40:01.578ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.67818ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
78182024-11-27T18:40:01.578ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78192024-11-27T18:40:01.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
78202024-11-27T18:40:01.580ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78212024-11-27T18:40:01.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78222024-11-27T18:40:01.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
78232024-11-27T18:40:01.581ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78242024-11-27T18:40:01.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78252024-11-27T18:40:01.583ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2435, tv_nsec: 580603145 } })
78262024-11-27T18:40:01.583ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78272024-11-27T18:40:01.583ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2435, tv_nsec: 580857908 } })
78282024-11-27T18:40:01.583ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
78292024-11-27T18:40:01.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
78302024-11-27T18:40:01.584ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
78312024-11-27T18:40:01.584ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78322024-11-27T18:40:01.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
78332024-11-27T18:40:01.586ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
78342024-11-27T18:40:01.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
78352024-11-27T18:40:01.588ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78362024-11-27T18:40:01.588ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78372024-11-27T18:40:01.590ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
78382024-11-27T18:40:01.590ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78392024-11-27T18:40:01.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78402024-11-27T18:40:01.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
78412024-11-27T18:40:01.591ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78422024-11-27T18:40:01.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78432024-11-27T18:40:01.594ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78442024-11-27T18:40:01.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78452024-11-27T18:40:01.595ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78462024-11-27T18:40:01.595ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78472024-11-27T18:40:01.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78482024-11-27T18:40:01.596ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78492024-11-27T18:40:01.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78502024-11-27T18:40:01.596ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
78512024-11-27T18:40:01.596ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78522024-11-27T18:40:01.597ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2435, tv_nsec: 594177826 } })
78532024-11-27T18:40:01.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78542024-11-27T18:40:01.597ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
78552024-11-27T18:40:01.612ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 37.383044ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
78562024-11-27T18:40:01.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78572024-11-27T18:40:01.614ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78582024-11-27T18:40:01.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78592024-11-27T18:40:01.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
78602024-11-27T18:40:01.616ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78612024-11-27T18:40:01.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78622024-11-27T18:40:01.619ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78632024-11-27T18:40:01.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78642024-11-27T18:40:01.621ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78652024-11-27T18:40:01.622ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 46.619811ms iteration = 12 status = {"errors":[],"records_set_to_done":[]}
78662024-11-27T18:40:01.622ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
78672024-11-27T18:40:01.622ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78682024-11-27T18:40:01.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
78692024-11-27T18:40:01.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78702024-11-27T18:40:01.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
78712024-11-27T18:40:01.624ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78722024-11-27T18:40:01.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78732024-11-27T18:40:01.626ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
78742024-11-27T18:40:01.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
78752024-11-27T18:40:01.627ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78762024-11-27T18:40:01.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78772024-11-27T18:40:01.628ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 52.669981ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
78782024-11-27T18:40:01.630ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
78792024-11-27T18:40:01.630ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
78802024-11-27T18:40:01.630ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78812024-11-27T18:40:01.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
78822024-11-27T18:40:01.642ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78832024-11-27T18:40:01.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
78842024-11-27T18:40:01.651ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78852024-11-27T18:40:01.653ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
78862024-11-27T18:40:01.653ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 77.55303ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
78872024-11-27T18:40:01.653ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
78882024-11-27T18:40:01.654ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 78.398232ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
78892024-11-27T18:40:01.654ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
78902024-11-27T18:40:01.654ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78912024-11-27T18:40:01.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78922024-11-27T18:40:01.664ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 89.06074ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
78932024-11-27T18:40:01.668ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 93.054249ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
78942024-11-27T18:40:01.672ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78952024-11-27T18:40:01.674ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
78962024-11-27T18:40:01.674ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
78972024-11-27T18:40:01.674ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78982024-11-27T18:40:01.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
78992024-11-27T18:40:01.674ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
79002024-11-27T18:40:01.674ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79012024-11-27T18:40:01.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79022024-11-27T18:40:01.676ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 101.482164ms iteration = 12 status = 0
79032024-11-27T18:40:01.684ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 108.644501ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
79042024-11-27T18:40:01.690ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
79052024-11-27T18:40:01.690ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79062024-11-27T18:40:01.690ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "47595e8c-4355-4861-ab91-83f8b1510ced", "content-length": "26", "date": "Wed, 27 Nov 2024 18:40:01 GMT"} })
79072024-11-27T18:40:01.690ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79082024-11-27T18:40:01.692ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
79092024-11-27T18:40:01.694ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
79102024-11-27T18:40:01.694ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79112024-11-27T18:40:01.694ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e72ecddd-fc68-45d8-a24e-1e60a28fb91f", "content-length": "26", "date": "Wed, 27 Nov 2024 18:40:01 GMT"} })
79122024-11-27T18:40:01.694ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79132024-11-27T18:40:01.696ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
79142024-11-27T18:40:01.696ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79152024-11-27T18:40:01.696ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
79162024-11-27T18:40:01.696ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f3e2cd3-9379-4204-8369-0d01ae8d1cb0", "content-length": "26", "date": "Wed, 27 Nov 2024 18:40:01 GMT"} })
79172024-11-27T18:40:01.696ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79182024-11-27T18:40:01.697ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
79192024-11-27T18:40:01.715ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
79202024-11-27T18:40:01.715ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
79212024-11-27T18:40:01.715ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 139.589789ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
79222024-11-27T18:40:01.722ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79232024-11-27T18:40:01.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79242024-11-27T18:40:01.724ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79252024-11-27T18:40:01.725ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
79262024-11-27T18:40:01.725ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79272024-11-27T18:40:01.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79282024-11-27T18:40:01.770ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 194.732495ms iteration = 14 status = {"physical_disks_added":0}
79292024-11-27T18:40:01.793ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
79302024-11-27T18:40:01.793ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
79312024-11-27T18:40:01.795ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79322024-11-27T18:40:01.797ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
79332024-11-27T18:40:01.797ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79342024-11-27T18:40:01.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79352024-11-27T18:40:01.805ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 229.801066ms iteration = 12 status = {}
79362024-11-27T18:40:01.808ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
79372024-11-27T18:40:01.808ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "03f77f25-eb25-4f50-8b55-0e3ca90aadf3", "content-length": "1", "date": "Wed, 27 Nov 2024 18:40:00 GMT"} })
79382024-11-27T18:40:01.809ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
79392024-11-27T18:40:01.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
79402024-11-27T18:40:01.812ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 236.530745ms iteration = 12 status = null
79412024-11-27T18:40:01.814ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a31f3f6c-5663-447d-b0d4-ee31982eb8e3", "content-length": "372", "date": "Wed, 27 Nov 2024 18:40:01 GMT"} })
79422024-11-27T18:40:01.814ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79432024-11-27T18:40:01.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79442024-11-27T18:40:01.860ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
79452024-11-27T18:40:01.860ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
79462024-11-27T18:40:01.860ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "8a1c876c-8330-48d9-9466-d6b541b326e2", "date": "Wed, 27 Nov 2024 18:40:01 GMT"} })
79472024-11-27T18:40:01.860ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79482024-11-27T18:40:01.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79492024-11-27T18:40:01.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79502024-11-27T18:40:01.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79512024-11-27T18:40:01.866ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79522024-11-27T18:40:01.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79532024-11-27T18:40:01.873ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
79542024-11-27T18:40:01.873ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
79552024-11-27T18:40:01.874ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a8405e5b-5aac-45b0-bcbb-eaf435a00488", "date": "Wed, 27 Nov 2024 18:40:01 GMT"} })
79562024-11-27T18:40:01.876ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 300.529774ms iteration = 13 status = {}
79572024-11-27T18:40:01.879ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79582024-11-27T18:40:01.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79592024-11-27T18:40:01.881ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
79602024-11-27T18:40:01.881ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79612024-11-27T18:40:01.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79622024-11-27T18:40:01.893ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
79632024-11-27T18:40:01.893ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "15f8a2b0-3791-4dd1-b41d-cd727b7093ec", "content-length": "134", "date": "Wed, 27 Nov 2024 18:40:01 GMT"} })
79642024-11-27T18:40:01.893ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
79652024-11-27T18:40:01.893ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
79662024-11-27T18:40:01.893ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
79672024-11-27T18:40:01.893ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
79682024-11-27T18:40:01.893ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79692024-11-27T18:40:01.893ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79702024-11-27T18:40:01.893ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79712024-11-27T18:40:01.893ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
79722024-11-27T18:40:01.893ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79732024-11-27T18:40:01.893ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
79742024-11-27T18:40:01.894ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
79752024-11-27T18:40:01.894ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79762024-11-27T18:40:01.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79772024-11-27T18:40:01.894ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
79782024-11-27T18:40:01.895ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c8058dc-a107-47fc-8099-c5446cde3a60", "content-length": "691", "date": "Wed, 27 Nov 2024 18:40:01 GMT"} })
79792024-11-27T18:40:01.895ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
79802024-11-27T18:40:01.895ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
79812024-11-27T18:40:01.895ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
79822024-11-27T18:40:01.895ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
79832024-11-27T18:40:01.895ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c593aff5-b4b5-4e50-8810-7253ed662df9", "content-length": "2", "date": "Wed, 27 Nov 2024 18:40:01 GMT"} })
79842024-11-27T18:40:01.895ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
79852024-11-27T18:40:01.896ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b1e6c00-2588-4848-975a-165a709bb9ea", "content-length": "52", "date": "Wed, 27 Nov 2024 18:40:01 GMT"} })
79862024-11-27T18:40:01.896ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
79872024-11-27T18:40:01.896ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
79882024-11-27T18:40:01.896ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 320.53672ms iteration = 12 status = {}
79892024-11-27T18:40:01.984ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7fee6f9e-5fe4-402a-81b4-b70f2b1dca77", "date": "Wed, 27 Nov 2024 18:40:01 GMT"} })
79902024-11-27T18:40:01.984ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
79912024-11-27T18:40:01.984ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
79922024-11-27T18:40:01.985ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4b41ba6-e5c1-477d-84a2-7d5c03d81027", "content-length": "682", "date": "Wed, 27 Nov 2024 18:40:01 GMT"} })
79932024-11-27T18:40:01.985ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79942024-11-27T18:40:01.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79952024-11-27T18:40:01.989ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79962024-11-27T18:40:01.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79972024-11-27T18:40:01.994ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79982024-11-27T18:40:01.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79992024-11-27T18:40:01.999ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80002024-11-27T18:40:01.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80012024-11-27T18:40:02.007ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 431.408634ms iteration = 12 status = {}
80022024-11-27T18:40:08.742ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1161 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = bc75ab54-252a-47a7-b7fa-928041559b13 response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
80032024-11-27T18:40:11.575ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
80042024-11-27T18:40:11.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
80052024-11-27T18:40:11.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80062024-11-27T18:40:11.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80072024-11-27T18:40:11.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80082024-11-27T18:40:11.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80092024-11-27T18:40:11.603ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80102024-11-27T18:40:11.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80112024-11-27T18:40:11.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80122024-11-27T18:40:11.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
80132024-11-27T18:40:11.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80142024-11-27T18:40:11.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80152024-11-27T18:40:11.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80162024-11-27T18:40:11.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80172024-11-27T18:40:11.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80182024-11-27T18:40:11.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
80192024-11-27T18:40:11.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80202024-11-27T18:40:11.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80212024-11-27T18:40:11.624ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
80222024-11-27T18:40:11.624ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.141168ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
80232024-11-27T18:40:11.633ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.087191ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
80242024-11-27T18:40:13.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 7f06a74f-52e2-4ad2-abe3-1380d75ef4b1 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
80252024-11-27T18:40:13.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 7f06a74f-52e2-4ad2-abe3-1380d75ef4b1 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
80262024-11-27T18:40:13.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2725 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 7f06a74f-52e2-4ad2-abe3-1380d75ef4b1 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
80272024-11-27T18:40:13.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = b3ae336f-d275-494a-803e-66931a92f469 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
80282024-11-27T18:40:13.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = b3ae336f-d275-494a-803e-66931a92f469 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
80292024-11-27T18:40:13.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2242 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = b3ae336f-d275-494a-803e-66931a92f469 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
80302024-11-27T18:40:18.742ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1220 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = f6e7b9a5-adc2-46bc-a94d-4b17e7e1735a response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
80312024-11-27T18:40:21.575ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
80322024-11-27T18:40:21.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
80332024-11-27T18:40:21.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80342024-11-27T18:40:21.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80352024-11-27T18:40:21.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80362024-11-27T18:40:21.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80372024-11-27T18:40:21.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80382024-11-27T18:40:21.578ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80392024-11-27T18:40:21.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80402024-11-27T18:40:21.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
80412024-11-27T18:40:21.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80422024-11-27T18:40:21.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80432024-11-27T18:40:21.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80442024-11-27T18:40:21.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80452024-11-27T18:40:21.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80462024-11-27T18:40:21.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
80472024-11-27T18:40:21.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80482024-11-27T18:40:21.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80492024-11-27T18:40:21.598ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
80502024-11-27T18:40:21.598ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.268895ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
80512024-11-27T18:40:21.608ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.577703ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
80522024-11-27T18:40:28.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 498486a7-d344-4d84-9305-fa9deac8b194 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
80532024-11-27T18:40:28.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 498486a7-d344-4d84-9305-fa9deac8b194 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
80542024-11-27T18:40:28.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3101 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 498486a7-d344-4d84-9305-fa9deac8b194 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
80552024-11-27T18:40:28.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 1c61cc83-daad-4491-b7aa-d6720b7b9c46 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
80562024-11-27T18:40:28.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 1c61cc83-daad-4491-b7aa-d6720b7b9c46 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
80572024-11-27T18:40:28.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2413 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 1c61cc83-daad-4491-b7aa-d6720b7b9c46 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
80582024-11-27T18:40:28.742ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1088 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 851ecdbc-f278-43c9-b791-b1dd343aeb19 response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
80592024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
80602024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
80612024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
80622024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
80632024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80642024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
80652024-11-27T18:40:31.575ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
80662024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
80672024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
80682024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80692024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
80702024-11-27T18:40:31.575ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 4ce244bc-1034-4855-877d-76a08bc15b71
80712024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.87\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"4ce244bc-1034-4855-877d-76a08bc15b71"}
80722024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
80732024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
80742024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80752024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
80762024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80772024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
80782024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
80792024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
80802024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
80812024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
80822024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
80832024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
80842024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
80852024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
80862024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
80872024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80882024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
80892024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
80902024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
80912024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80922024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
80932024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
80942024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
80952024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80962024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
80972024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
80982024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
80992024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
81002024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
81012024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
81022024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
81032024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
81042024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
81052024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
81062024-11-27T18:40:31.575ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
81072024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
81082024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
81092024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
81102024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
81112024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
81122024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
81132024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
81142024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
81152024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
81162024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81172024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
81182024-11-27T18:40:31.575ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-27 18:30:31.575520208 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
81192024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
81202024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
81212024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
81222024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
81232024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
81242024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81252024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81262024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
81272024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
81282024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81292024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
81302024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
81312024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
81322024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
81332024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
81342024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81352024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81362024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81372024-11-27T18:40:31.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
81382024-11-27T18:40:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81392024-11-27T18:40:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
81402024-11-27T18:40:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
81412024-11-27T18:40:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
81422024-11-27T18:40:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
81432024-11-27T18:40:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
81442024-11-27T18:40:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
81452024-11-27T18:40:31.576ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f378a24-7578-4d72-8454-f489a3e51ffb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e203eafc-5cbd-4249-8d8a-770878ed4d6d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 2465, tv_nsec: 573022012 } })
81462024-11-27T18:40:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
81472024-11-27T18:40:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
81482024-11-27T18:40:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
81492024-11-27T18:40:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
81502024-11-27T18:40:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
81512024-11-27T18:40:31.576ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
81522024-11-27T18:40:31.576ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("923a7051-0539-4413-bab4-c2b0d3395fe2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2465, tv_nsec: 573151174 } })
81532024-11-27T18:40:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
81542024-11-27T18:40:31.576ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
81552024-11-27T18:40:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
81562024-11-27T18:40:31.576ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
81572024-11-27T18:40:31.576ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
81582024-11-27T18:40:31.576ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.258268ms iteration = 8 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
81592024-11-27T18:40:31.576ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
81602024-11-27T18:40:31.576ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.176038ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
81612024-11-27T18:40:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
81622024-11-27T18:40:31.579ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.898878ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
81632024-11-27T18:40:31.580ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2465, tv_nsec: 577405548 } })
81642024-11-27T18:40:31.580ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
81652024-11-27T18:40:31.581ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81662024-11-27T18:40:31.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
81672024-11-27T18:40:31.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
81682024-11-27T18:40:31.583ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2465, tv_nsec: 580305120 } })
81692024-11-27T18:40:31.583ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
81702024-11-27T18:40:31.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
81712024-11-27T18:40:31.584ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
81722024-11-27T18:40:31.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
81732024-11-27T18:40:31.589ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-27 18:30:31.575520208 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
81742024-11-27T18:40:31.589ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 14.431924ms iteration = 7 status = {"expiration":"2024-11-27T18:30:31.575520208Z","pruned":[]}
81752024-11-27T18:40:31.592ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
81762024-11-27T18:40:31.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
81772024-11-27T18:40:31.593ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
81782024-11-27T18:40:31.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
81792024-11-27T18:40:31.595ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.501254ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
81802024-11-27T18:40:31.630ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
81812024-11-27T18:40:31.630ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81822024-11-27T18:40:31.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
81832024-11-27T18:40:31.631ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81842024-11-27T18:40:31.632ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81852024-11-27T18:40:31.632ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81862024-11-27T18:40:31.633ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81872024-11-27T18:40:31.634ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81882024-11-27T18:40:31.634ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
81892024-11-27T18:40:31.634ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81902024-11-27T18:40:31.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81912024-11-27T18:40:31.635ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
81922024-11-27T18:40:31.635ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81932024-11-27T18:40:31.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81942024-11-27T18:40:31.635ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
81952024-11-27T18:40:31.635ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81962024-11-27T18:40:31.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81972024-11-27T18:40:31.636ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
81982024-11-27T18:40:31.636ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
81992024-11-27T18:40:31.636ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
82002024-11-27T18:40:31.636ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
82012024-11-27T18:40:31.636ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
82022024-11-27T18:40:31.636ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
82032024-11-27T18:40:31.636ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
82042024-11-27T18:40:31.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
82052024-11-27T18:40:31.636ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
82062024-11-27T18:40:31.636ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82072024-11-27T18:40:31.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
82082024-11-27T18:40:31.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
82092024-11-27T18:40:31.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82102024-11-27T18:40:31.638ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82112024-11-27T18:40:31.639ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82122024-11-27T18:40:31.639ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82132024-11-27T18:40:31.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
82142024-11-27T18:40:31.641ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
82152024-11-27T18:40:31.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
82162024-11-27T18:40:31.641ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82172024-11-27T18:40:31.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82182024-11-27T18:40:31.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
82192024-11-27T18:40:31.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
82202024-11-27T18:40:31.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
82212024-11-27T18:40:31.644ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
82222024-11-27T18:40:31.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
82232024-11-27T18:40:31.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82242024-11-27T18:40:31.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82252024-11-27T18:40:31.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82262024-11-27T18:40:31.647ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82272024-11-27T18:40:31.647ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 71.996988ms iteration = 13 status = {"errors":[],"records_set_to_done":[]}
82282024-11-27T18:40:31.647ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
82292024-11-27T18:40:31.647ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
82302024-11-27T18:40:31.647ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 72.511925ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
82312024-11-27T18:40:31.647ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82322024-11-27T18:40:31.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82332024-11-27T18:40:31.647ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82342024-11-27T18:40:31.649ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82352024-11-27T18:40:31.649ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
82362024-11-27T18:40:31.649ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
82372024-11-27T18:40:31.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82382024-11-27T18:40:31.649ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
82392024-11-27T18:40:31.649ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2465, tv_nsec: 646902507 } })
82402024-11-27T18:40:31.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
82412024-11-27T18:40:31.650ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
82422024-11-27T18:40:31.650ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82432024-11-27T18:40:31.650ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
82442024-11-27T18:40:31.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82452024-11-27T18:40:31.650ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82462024-11-27T18:40:31.650ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
82472024-11-27T18:40:31.650ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
82482024-11-27T18:40:31.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
82492024-11-27T18:40:31.652ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 76.93536ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
82502024-11-27T18:40:31.652ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
82512024-11-27T18:40:31.652ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82522024-11-27T18:40:31.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82532024-11-27T18:40:31.653ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82542024-11-27T18:40:31.654ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82552024-11-27T18:40:31.654ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
82562024-11-27T18:40:31.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82572024-11-27T18:40:31.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
82582024-11-27T18:40:31.655ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82592024-11-27T18:40:31.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82602024-11-27T18:40:31.656ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
82612024-11-27T18:40:31.656ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
82622024-11-27T18:40:31.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
82632024-11-27T18:40:31.656ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
82642024-11-27T18:40:31.656ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 81.63458ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
82652024-11-27T18:40:31.658ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82662024-11-27T18:40:31.660ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82672024-11-27T18:40:31.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82682024-11-27T18:40:31.661ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
82692024-11-27T18:40:31.661ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82702024-11-27T18:40:31.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82712024-11-27T18:40:31.663ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82722024-11-27T18:40:31.664ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 89.121081ms iteration = 4 status = {"nsuccess":5}
82732024-11-27T18:40:31.667ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
82742024-11-27T18:40:31.667ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82752024-11-27T18:40:31.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82762024-11-27T18:40:31.671ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 96.573601ms iteration = 15 status = {"physical_disks_added":0}
82772024-11-27T18:40:31.674ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 99.537905ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
82782024-11-27T18:40:31.686ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
82792024-11-27T18:40:31.687ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
82802024-11-27T18:40:31.687ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
82812024-11-27T18:40:31.687ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
82822024-11-27T18:40:31.687ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
82832024-11-27T18:40:31.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
82842024-11-27T18:40:31.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
82852024-11-27T18:40:31.690ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
82862024-11-27T18:40:31.690ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
82872024-11-27T18:40:31.690ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
82882024-11-27T18:40:31.690ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
82892024-11-27T18:40:31.691ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
82902024-11-27T18:40:31.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
82912024-11-27T18:40:31.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
82922024-11-27T18:40:31.693ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82932024-11-27T18:40:31.694ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82942024-11-27T18:40:31.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82952024-11-27T18:40:31.697ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82962024-11-27T18:40:31.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82972024-11-27T18:40:31.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
82982024-11-27T18:40:31.698ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
82992024-11-27T18:40:31.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
83002024-11-27T18:40:31.699ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83012024-11-27T18:40:31.701ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 125.733724ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
83022024-11-27T18:40:31.702ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
83032024-11-27T18:40:31.702ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83042024-11-27T18:40:31.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83052024-11-27T18:40:31.704ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 129.795153ms iteration = 13 status = 0
83062024-11-27T18:40:31.705ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 130.090678ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83072024-11-27T18:40:31.705ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
83082024-11-27T18:40:31.705ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
83092024-11-27T18:40:31.705ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 130.148959ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
83102024-11-27T18:40:31.708ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
83112024-11-27T18:40:31.708ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
83122024-11-27T18:40:31.708ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 132.739077ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
83132024-11-27T18:40:31.712ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83142024-11-27T18:40:31.716ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
83152024-11-27T18:40:31.716ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83162024-11-27T18:40:31.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83172024-11-27T18:40:31.716ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83182024-11-27T18:40:31.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83192024-11-27T18:40:31.730ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
83202024-11-27T18:40:31.730ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 155.176341ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
83212024-11-27T18:40:31.730ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 155.667207ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
83222024-11-27T18:40:31.730ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
83232024-11-27T18:40:31.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
83242024-11-27T18:40:31.732ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83252024-11-27T18:40:31.732ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83262024-11-27T18:40:31.734ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
83272024-11-27T18:40:31.734ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 0 version = 2
83282024-11-27T18:40:31.734ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
83292024-11-27T18:40:31.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
83302024-11-27T18:40:31.735ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
83312024-11-27T18:40:31.735ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
83322024-11-27T18:40:31.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
83332024-11-27T18:40:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
83342024-11-27T18:40:31.736ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
83352024-11-27T18:40:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
83362024-11-27T18:40:31.736ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83372024-11-27T18:40:31.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
83382024-11-27T18:40:31.739ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
83392024-11-27T18:40:31.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
83402024-11-27T18:40:31.741ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 1 version = 2
83412024-11-27T18:40:31.741ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
83422024-11-27T18:40:31.741ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-27 18:34:44.388958 UTC dns_group = external generation = 2
83432024-11-27T18:40:31.741ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 165.99426ms iteration = 8 status = {"generation":2}
83442024-11-27T18:40:31.757ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83452024-11-27T18:40:31.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83462024-11-27T18:40:31.772ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
83472024-11-27T18:40:31.772ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
83482024-11-27T18:40:31.772ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
83492024-11-27T18:40:31.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
83502024-11-27T18:40:31.774ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-27T18:34:28.564237Z, time_modified: 2024-11-27T18:34:28.564237Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }) }
83512024-11-27T18:40:31.774ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 198.534382ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]}},"default_endpoint":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
83522024-11-27T18:40:31.796ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83532024-11-27T18:40:31.797ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
83542024-11-27T18:40:31.797ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83552024-11-27T18:40:31.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83562024-11-27T18:40:31.803ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
83572024-11-27T18:40:31.803ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 228.606358ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
83582024-11-27T18:40:31.815ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
83592024-11-27T18:40:31.815ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
83602024-11-27T18:40:31.815ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "99b844d5-af08-491b-89f9-7125ae3edf05", "content-length": "26", "date": "Wed, 27 Nov 2024 18:40:31 GMT"} })
83612024-11-27T18:40:31.815ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
83622024-11-27T18:40:31.818ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
83632024-11-27T18:40:31.859ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
83642024-11-27T18:40:31.859ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
83652024-11-27T18:40:31.860ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "23c2376c-cb65-4c62-a2aa-fd52b28e9db2", "content-length": "26", "date": "Wed, 27 Nov 2024 18:40:31 GMT"} })
83662024-11-27T18:40:31.860ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
83672024-11-27T18:40:31.862ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
83682024-11-27T18:40:31.870ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
83692024-11-27T18:40:31.870ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
83702024-11-27T18:40:31.871ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "893f8bfa-af07-477f-95a0-bbcde416f734", "content-length": "26", "date": "Wed, 27 Nov 2024 18:40:31 GMT"} })
83712024-11-27T18:40:31.871ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
83722024-11-27T18:40:31.873ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
83732024-11-27T18:40:31.873ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
83742024-11-27T18:40:31.889ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
83752024-11-27T18:40:31.906ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
83762024-11-27T18:40:31.906ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
83772024-11-27T18:40:31.906ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d41d7140-87a6-48b5-a45b-1b0e6cf72173", "content-length": "372", "date": "Wed, 27 Nov 2024 18:40:31 GMT"} })
83782024-11-27T18:40:31.906ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83792024-11-27T18:40:31.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83802024-11-27T18:40:31.908ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83812024-11-27T18:40:31.910ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
83822024-11-27T18:40:31.910ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83832024-11-27T18:40:31.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83842024-11-27T18:40:31.939ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83852024-11-27T18:40:31.942ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
83862024-11-27T18:40:31.942ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
83872024-11-27T18:40:31.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
83882024-11-27T18:40:31.945ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
83892024-11-27T18:40:31.945ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
83902024-11-27T18:40:31.945ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-27 18:34:43.283070 UTC dns_group = internal generation = 1
83912024-11-27T18:40:31.945ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 369.958424ms iteration = 8 status = {"generation":1}
83922024-11-27T18:40:31.964ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
83932024-11-27T18:40:31.964ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
83942024-11-27T18:40:31.988ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
83952024-11-27T18:40:31.989ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "93e3f452-e99d-4017-b70e-06f9ea3bf4c7", "content-length": "1", "date": "Wed, 27 Nov 2024 18:40:31 GMT"} })
83962024-11-27T18:40:31.991ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
83972024-11-27T18:40:31.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
83982024-11-27T18:40:31.994ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 419.306965ms iteration = 13 status = null
83992024-11-27T18:40:32.056ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 481.140071ms iteration = 13 status = {}
84002024-11-27T18:40:32.075ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4f8b2e93-45e1-413a-834d-3b0a45444400", "date": "Wed, 27 Nov 2024 18:40:31 GMT"} })
84012024-11-27T18:40:32.075ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84022024-11-27T18:40:32.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84032024-11-27T18:40:32.078ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84042024-11-27T18:40:32.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84052024-11-27T18:40:32.131ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
84062024-11-27T18:40:32.161ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
84072024-11-27T18:40:32.161ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "020ca94f-aa91-4af7-942f-7d3d7d231ae7", "content-length": "691", "date": "Wed, 27 Nov 2024 18:40:32 GMT"} })
84082024-11-27T18:40:32.161ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
84092024-11-27T18:40:32.161ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
84102024-11-27T18:40:32.161ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
84112024-11-27T18:40:32.163ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 588.247179ms iteration = 13 status = {}
84122024-11-27T18:40:32.165ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84132024-11-27T18:40:32.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84142024-11-27T18:40:32.168ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
84152024-11-27T18:40:32.168ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
84162024-11-27T18:40:32.168ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "01f90724-8738-432b-a688-a1022f199334", "date": "Wed, 27 Nov 2024 18:40:32 GMT"} })
84172024-11-27T18:40:32.171ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 595.514886ms iteration = 14 status = {}
84182024-11-27T18:40:32.180ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
84192024-11-27T18:40:32.180ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "c73ff3f8-e187-4caa-810f-d69adf8eef1b", "date": "Wed, 27 Nov 2024 18:40:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
84202024-11-27T18:40:32.180ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
84212024-11-27T18:40:32.182ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "4aa1e83b-ab22-4567-b32c-a79d4dcb5b2a", "date": "Wed, 27 Nov 2024 18:40:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
84222024-11-27T18:40:32.182ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
84232024-11-27T18:40:32.184ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
84242024-11-27T18:40:32.184ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 609.013547ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
84252024-11-27T18:40:32.209ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
84262024-11-27T18:40:32.209ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "17fe02f5-a601-460f-869d-bd34acd5d983", "date": "Wed, 27 Nov 2024 18:40:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
84272024-11-27T18:40:32.209ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
84282024-11-27T18:40:32.211ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "331917f1-d6b9-4e0b-8ca5-a8ac06434206", "date": "Wed, 27 Nov 2024 18:40:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
84292024-11-27T18:40:32.211ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
84302024-11-27T18:40:32.213ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "630ba10c-06ad-4d62-b4ad-bf7348389a05", "date": "Wed, 27 Nov 2024 18:40:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
84312024-11-27T18:40:32.213ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
84322024-11-27T18:40:32.213ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84332024-11-27T18:40:32.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84342024-11-27T18:40:32.215ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
84352024-11-27T18:40:32.215ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 640.567954ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
84362024-11-27T18:40:32.216ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
84372024-11-27T18:40:32.216ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84382024-11-27T18:40:32.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84392024-11-27T18:40:32.228ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
84402024-11-27T18:40:32.228ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "432fe516-cace-4cd3-a344-32da94446328", "content-length": "134", "date": "Wed, 27 Nov 2024 18:40:32 GMT"} })
84412024-11-27T18:40:32.228ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
84422024-11-27T18:40:32.228ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
84432024-11-27T18:40:32.228ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
84442024-11-27T18:40:32.228ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
84452024-11-27T18:40:32.228ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84462024-11-27T18:40:32.228ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84472024-11-27T18:40:32.228ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84482024-11-27T18:40:32.228ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
84492024-11-27T18:40:32.228ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84502024-11-27T18:40:32.228ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
84512024-11-27T18:40:32.229ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
84522024-11-27T18:40:32.229ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84532024-11-27T18:40:32.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84542024-11-27T18:40:32.231ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
84552024-11-27T18:40:32.231ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f348b899-e44c-4f0a-ad08-202cc192ee6e", "content-length": "2", "date": "Wed, 27 Nov 2024 18:40:32 GMT"} })
84562024-11-27T18:40:32.231ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
84572024-11-27T18:40:32.231ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "efac99da-d24d-4a70-9799-d83ea35edffa", "content-length": "52", "date": "Wed, 27 Nov 2024 18:40:32 GMT"} })
84582024-11-27T18:40:32.231ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
84592024-11-27T18:40:32.231ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
84602024-11-27T18:40:32.326ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "479917b8-983a-40e9-bd03-074e8c829a5d", "date": "Wed, 27 Nov 2024 18:40:32 GMT"} })
84612024-11-27T18:40:32.326ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
84622024-11-27T18:40:32.326ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
84632024-11-27T18:40:32.326ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c81062f4-74b2-4803-8e59-60a7c61c343d", "content-length": "682", "date": "Wed, 27 Nov 2024 18:40:31 GMT"} })
84642024-11-27T18:40:32.326ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84652024-11-27T18:40:32.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84662024-11-27T18:40:32.332ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84672024-11-27T18:40:32.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84682024-11-27T18:40:32.336ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84692024-11-27T18:40:32.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84702024-11-27T18:40:32.339ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84712024-11-27T18:40:32.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84722024-11-27T18:40:32.347ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 771.87977ms iteration = 13 status = {}
84732024-11-27T18:40:38.742ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1066 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 6962da31-e9f8-4b0b-8cd8-230abf1f1918 response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
84742024-11-27T18:40:41.575ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
84752024-11-27T18:40:41.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
84762024-11-27T18:40:41.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84772024-11-27T18:40:41.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84782024-11-27T18:40:41.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84792024-11-27T18:40:41.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84802024-11-27T18:40:41.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84812024-11-27T18:40:41.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84822024-11-27T18:40:41.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84832024-11-27T18:40:41.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84842024-11-27T18:40:41.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84852024-11-27T18:40:41.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84862024-11-27T18:40:41.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84872024-11-27T18:40:41.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
84882024-11-27T18:40:41.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84892024-11-27T18:40:41.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84902024-11-27T18:40:41.601ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
84912024-11-27T18:40:41.601ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.127937ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
84922024-11-27T18:40:41.610ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84932024-11-27T18:40:41.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84942024-11-27T18:40:41.639ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.201826ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84952024-11-27T18:40:43.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 19d63bce-f263-4dad-b0a9-9c6a0a0c15c2 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
84962024-11-27T18:40:43.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 19d63bce-f263-4dad-b0a9-9c6a0a0c15c2 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
84972024-11-27T18:40:43.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2740 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 19d63bce-f263-4dad-b0a9-9c6a0a0c15c2 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
84982024-11-27T18:40:43.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = ed0a2021-7b18-4e73-b696-e7901420dd2c roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
84992024-11-27T18:40:43.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = ed0a2021-7b18-4e73-b696-e7901420dd2c resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
85002024-11-27T18:40:43.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2553 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = ed0a2021-7b18-4e73-b696-e7901420dd2c response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
85012024-11-27T18:40:48.377ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:36652
85022024-11-27T18:40:48.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36652 req_id = ba033d09-40c4-4591-b5b4-45e164e1b474 roles = RoleSet { roles: {} } uri = /metrics/producers
85032024-11-27T18:40:48.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36652 req_id = ba033d09-40c4-4591-b5b4-45e164e1b474 resource = Database result = Ok(()) uri = /metrics/producers
85042024-11-27T18:40:48.415ZINFOnexus: assigned collector to new producer collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:76 producer_id = d7cc4ac1-6d92-4a20-8b63-97d7517b1cd5
85052024-11-27T18:40:48.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37999 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36652 req_id = ba033d09-40c4-4591-b5b4-45e164e1b474 response_code = 201 uri = /metrics/producers
85062024-11-27T18:40:48.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1338 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 91177bff-ee5a-4a47-94bb-f731e9a15e46 response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
85072024-11-27T18:40:51.575ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
85082024-11-27T18:40:51.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
85092024-11-27T18:40:51.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85102024-11-27T18:40:51.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85112024-11-27T18:40:51.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85122024-11-27T18:40:51.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85132024-11-27T18:40:51.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85142024-11-27T18:40:51.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85152024-11-27T18:40:51.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85162024-11-27T18:40:51.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85172024-11-27T18:40:51.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85182024-11-27T18:40:51.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85192024-11-27T18:40:51.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85202024-11-27T18:40:51.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
85212024-11-27T18:40:51.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85222024-11-27T18:40:51.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85232024-11-27T18:40:51.598ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
85242024-11-27T18:40:51.598ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.665266ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
85252024-11-27T18:40:51.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85262024-11-27T18:40:51.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85272024-11-27T18:40:51.629ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.015771ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
85282024-11-27T18:40:58.742ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1011 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = fc8c2676-da12-4e5f-969e-4b125f884956 response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
85292024-11-27T18:41:01.575ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
85302024-11-27T18:41:01.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
85312024-11-27T18:41:01.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
85322024-11-27T18:41:01.575ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85332024-11-27T18:41:01.575ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
85342024-11-27T18:41:01.575ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85352024-11-27T18:41:01.575ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
85362024-11-27T18:41:01.575ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
85372024-11-27T18:41:01.575ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
85382024-11-27T18:41:01.575ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
85392024-11-27T18:41:01.575ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
85402024-11-27T18:41:01.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
85412024-11-27T18:41:01.575ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
85422024-11-27T18:41:01.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85432024-11-27T18:41:01.575ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85442024-11-27T18:41:01.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
85452024-11-27T18:41:01.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
85462024-11-27T18:41:01.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85472024-11-27T18:41:01.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
85482024-11-27T18:41:01.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
85492024-11-27T18:41:01.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
85502024-11-27T18:41:01.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
85512024-11-27T18:41:01.575ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
85522024-11-27T18:41:01.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
85532024-11-27T18:41:01.575ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85542024-11-27T18:41:01.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
85552024-11-27T18:41:01.575ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
85562024-11-27T18:41:01.575ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
85572024-11-27T18:41:01.575ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
85582024-11-27T18:41:01.575ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
85592024-11-27T18:41:01.575ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
85602024-11-27T18:41:01.575ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
85612024-11-27T18:41:01.575ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85622024-11-27T18:41:01.575ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
85632024-11-27T18:41:01.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85642024-11-27T18:41:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85652024-11-27T18:41:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85662024-11-27T18:41:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
85672024-11-27T18:41:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85682024-11-27T18:41:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
85692024-11-27T18:41:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85702024-11-27T18:41:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
85712024-11-27T18:41:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
85722024-11-27T18:41:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
85732024-11-27T18:41:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85742024-11-27T18:41:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85752024-11-27T18:41:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85762024-11-27T18:41:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
85772024-11-27T18:41:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85782024-11-27T18:41:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
85792024-11-27T18:41:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
85802024-11-27T18:41:01.578ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85812024-11-27T18:41:01.578ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85822024-11-27T18:41:01.579ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.487086ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
85832024-11-27T18:41:01.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
85842024-11-27T18:41:01.581ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85852024-11-27T18:41:01.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85862024-11-27T18:41:01.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
85872024-11-27T18:41:01.582ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85882024-11-27T18:41:01.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85892024-11-27T18:41:01.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85902024-11-27T18:41:01.585ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2495, tv_nsec: 582056077 } })
85912024-11-27T18:41:01.585ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
85922024-11-27T18:41:01.586ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85932024-11-27T18:41:01.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85942024-11-27T18:41:01.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85952024-11-27T18:41:01.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85962024-11-27T18:41:01.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85972024-11-27T18:41:01.589ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2495, tv_nsec: 586793047 } })
85982024-11-27T18:41:01.590ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
85992024-11-27T18:41:01.590ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86002024-11-27T18:41:01.591ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86012024-11-27T18:41:01.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86022024-11-27T18:41:01.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86032024-11-27T18:41:01.592ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86042024-11-27T18:41:01.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86052024-11-27T18:41:01.623ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
86062024-11-27T18:41:01.623ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
86072024-11-27T18:41:01.623ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
86082024-11-27T18:41:01.623ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 48.355096ms iteration = 14 status = {"errors":[],"records_set_to_done":[]}
86092024-11-27T18:41:01.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
86102024-11-27T18:41:01.626ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
86112024-11-27T18:41:01.626ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
86122024-11-27T18:41:01.626ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
86132024-11-27T18:41:01.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
86142024-11-27T18:41:01.629ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86152024-11-27T18:41:01.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86162024-11-27T18:41:01.631ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
86172024-11-27T18:41:01.631ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 56.207763ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
86182024-11-27T18:41:01.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
86192024-11-27T18:41:01.632ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86202024-11-27T18:41:01.632ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86212024-11-27T18:41:01.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86222024-11-27T18:41:01.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
86232024-11-27T18:41:01.634ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.080145ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86242024-11-27T18:41:01.634ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
86252024-11-27T18:41:01.634ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
86262024-11-27T18:41:01.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
86272024-11-27T18:41:01.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
86282024-11-27T18:41:01.635ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86292024-11-27T18:41:01.635ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86302024-11-27T18:41:01.637ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
86312024-11-27T18:41:01.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
86322024-11-27T18:41:01.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
86332024-11-27T18:41:01.638ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86342024-11-27T18:41:01.638ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
86352024-11-27T18:41:01.638ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86362024-11-27T18:41:01.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86372024-11-27T18:41:01.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86382024-11-27T18:41:01.639ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86392024-11-27T18:41:01.639ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 64.063429ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
86402024-11-27T18:41:01.641ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
86412024-11-27T18:41:01.641ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86422024-11-27T18:41:01.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86432024-11-27T18:41:01.643ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2495, tv_nsec: 640158188 } })
86442024-11-27T18:41:01.643ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
86452024-11-27T18:41:01.646ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86462024-11-27T18:41:01.650ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
86472024-11-27T18:41:01.650ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86482024-11-27T18:41:01.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86492024-11-27T18:41:01.666ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
86502024-11-27T18:41:01.666ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86512024-11-27T18:41:01.667ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5b94f70-e7cd-43a1-bce3-9685c1b6614b", "content-length": "26", "date": "Wed, 27 Nov 2024 18:41:01 GMT"} })
86522024-11-27T18:41:01.667ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86532024-11-27T18:41:01.667ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
86542024-11-27T18:41:01.667ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 91.604488ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
86552024-11-27T18:41:01.668ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
86562024-11-27T18:41:01.668ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
86572024-11-27T18:41:01.668ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 92.668194ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
86582024-11-27T18:41:01.669ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
86592024-11-27T18:41:01.673ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86602024-11-27T18:41:01.675ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
86612024-11-27T18:41:01.675ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 100.116024ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
86622024-11-27T18:41:01.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
86632024-11-27T18:41:01.676ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
86642024-11-27T18:41:01.676ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86652024-11-27T18:41:01.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86662024-11-27T18:41:01.678ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
86672024-11-27T18:41:01.678ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 102.963716ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
86682024-11-27T18:41:01.679ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 103.863819ms iteration = 14 status = 0
86692024-11-27T18:41:01.681ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86702024-11-27T18:41:01.684ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
86712024-11-27T18:41:01.684ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86722024-11-27T18:41:01.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86732024-11-27T18:41:01.684ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
86742024-11-27T18:41:01.684ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86752024-11-27T18:41:01.685ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "25f79daf-5a96-4792-a14e-26505ac1ef3f", "content-length": "26", "date": "Wed, 27 Nov 2024 18:41:01 GMT"} })
86762024-11-27T18:41:01.685ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86772024-11-27T18:41:01.687ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
86782024-11-27T18:41:01.717ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 142.166618ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
86792024-11-27T18:41:01.738ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86802024-11-27T18:41:01.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86812024-11-27T18:41:01.774ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
86822024-11-27T18:41:01.774ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 199.355964ms iteration = 16 status = {"physical_disks_added":0}
86832024-11-27T18:41:01.775ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d145add3-c2fc-4ef0-89c9-7ec6be768f07", "content-length": "1", "date": "Wed, 27 Nov 2024 18:41:00 GMT"} })
86842024-11-27T18:41:01.776ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
86852024-11-27T18:41:01.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
86862024-11-27T18:41:01.779ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
86872024-11-27T18:41:01.779ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86882024-11-27T18:41:01.779ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4371c6b9-a931-4967-b89a-fc6e2b186c1c", "content-length": "26", "date": "Wed, 27 Nov 2024 18:41:01 GMT"} })
86892024-11-27T18:41:01.779ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86902024-11-27T18:41:01.779ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 204.056783ms iteration = 14 status = null
86912024-11-27T18:41:01.781ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
86922024-11-27T18:41:01.822ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 246.533713ms iteration = 14 status = {}
86932024-11-27T18:41:01.854ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
86942024-11-27T18:41:01.854ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
86952024-11-27T18:41:01.856ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86962024-11-27T18:41:01.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86972024-11-27T18:41:01.884ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86982024-11-27T18:41:01.887ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
86992024-11-27T18:41:01.887ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87002024-11-27T18:41:01.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87012024-11-27T18:41:01.889ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87022024-11-27T18:41:01.891ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
87032024-11-27T18:41:01.891ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87042024-11-27T18:41:01.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87052024-11-27T18:41:01.909ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b1669aa-63e2-41f0-8408-050847a34639", "content-length": "372", "date": "Wed, 27 Nov 2024 18:41:01 GMT"} })
87062024-11-27T18:41:01.909ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87072024-11-27T18:41:01.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87082024-11-27T18:41:01.924ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
87092024-11-27T18:41:01.924ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
87102024-11-27T18:41:01.925ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ea0cbd92-d650-468e-8e95-2b95d5b4b44b", "date": "Wed, 27 Nov 2024 18:41:01 GMT"} })
87112024-11-27T18:41:01.925ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87122024-11-27T18:41:01.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87132024-11-27T18:41:01.927ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87142024-11-27T18:41:01.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87152024-11-27T18:41:01.930ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87162024-11-27T18:41:01.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87172024-11-27T18:41:01.931ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
87182024-11-27T18:41:01.931ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "bcbf77fd-ebca-4817-985c-061397f988b0", "content-length": "691", "date": "Wed, 27 Nov 2024 18:41:01 GMT"} })
87192024-11-27T18:41:01.931ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
87202024-11-27T18:41:01.931ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
87212024-11-27T18:41:01.931ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
87222024-11-27T18:41:01.931ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87232024-11-27T18:41:01.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87242024-11-27T18:41:01.933ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 357.663211ms iteration = 14 status = {}
87252024-11-27T18:41:01.933ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
87262024-11-27T18:41:01.933ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87272024-11-27T18:41:01.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87282024-11-27T18:41:01.934ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
87292024-11-27T18:41:01.934ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
87302024-11-27T18:41:01.934ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ccafbb3b-644b-4e63-854b-a7bd85f4f4cb", "date": "Wed, 27 Nov 2024 18:41:01 GMT"} })
87312024-11-27T18:41:01.936ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 360.473213ms iteration = 15 status = {}
87322024-11-27T18:41:01.940ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
87332024-11-27T18:41:01.940ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b60872f5-3f57-452f-86c2-c5f0da659dbb", "content-length": "134", "date": "Wed, 27 Nov 2024 18:41:01 GMT"} })
87342024-11-27T18:41:01.940ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
87352024-11-27T18:41:01.940ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
87362024-11-27T18:41:01.940ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
87372024-11-27T18:41:01.940ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
87382024-11-27T18:41:01.940ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87392024-11-27T18:41:01.940ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87402024-11-27T18:41:01.940ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87412024-11-27T18:41:01.940ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
87422024-11-27T18:41:01.940ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87432024-11-27T18:41:01.940ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
87442024-11-27T18:41:01.941ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
87452024-11-27T18:41:01.941ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87462024-11-27T18:41:01.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87472024-11-27T18:41:01.943ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
87482024-11-27T18:41:01.943ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c3b51e3-0375-40db-a856-024a6b5319cd", "content-length": "2", "date": "Wed, 27 Nov 2024 18:41:01 GMT"} })
87492024-11-27T18:41:01.943ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
87502024-11-27T18:41:01.943ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b358f2fa-6c08-4a5a-a5ab-e7a78996b8ff", "content-length": "52", "date": "Wed, 27 Nov 2024 18:41:01 GMT"} })
87512024-11-27T18:41:01.943ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
87522024-11-27T18:41:01.943ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
87532024-11-27T18:41:02.049ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b0a48542-1a7c-4ca5-a940-a62d10a1a147", "date": "Wed, 27 Nov 2024 18:41:01 GMT"} })
87542024-11-27T18:41:02.049ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
87552024-11-27T18:41:02.049ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
87562024-11-27T18:41:02.049ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "288c3dc6-b9db-4e39-b55c-42c89c1d75b0", "content-length": "682", "date": "Wed, 27 Nov 2024 18:41:01 GMT"} })
87572024-11-27T18:41:02.049ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87582024-11-27T18:41:02.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87592024-11-27T18:41:02.053ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87602024-11-27T18:41:02.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87612024-11-27T18:41:02.056ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87622024-11-27T18:41:02.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87632024-11-27T18:41:02.058ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87642024-11-27T18:41:02.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87652024-11-27T18:41:02.064ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 489.060588ms iteration = 14 status = {}
87662024-11-27T18:41:08.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1134 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 18a7109e-9363-49f0-9ec9-8631ba94d9bd response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
87672024-11-27T18:41:11.575ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
87682024-11-27T18:41:11.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
87692024-11-27T18:41:11.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87702024-11-27T18:41:11.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87712024-11-27T18:41:11.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87722024-11-27T18:41:11.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87732024-11-27T18:41:11.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87742024-11-27T18:41:11.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87752024-11-27T18:41:11.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87762024-11-27T18:41:11.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87772024-11-27T18:41:11.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87782024-11-27T18:41:11.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87792024-11-27T18:41:11.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87802024-11-27T18:41:11.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
87812024-11-27T18:41:11.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87822024-11-27T18:41:11.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87832024-11-27T18:41:11.597ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
87842024-11-27T18:41:11.597ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.339051ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
87852024-11-27T18:41:11.610ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87862024-11-27T18:41:11.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87872024-11-27T18:41:11.611ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.241097ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
87882024-11-27T18:41:13.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = c97bd068-593c-4466-8999-afa89688ad70 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
87892024-11-27T18:41:13.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = c97bd068-593c-4466-8999-afa89688ad70 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
87902024-11-27T18:41:13.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2534 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = c97bd068-593c-4466-8999-afa89688ad70 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
87912024-11-27T18:41:13.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 608d9651-d42e-4e72-88ee-3bb287008c02 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
87922024-11-27T18:41:13.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 608d9651-d42e-4e72-88ee-3bb287008c02 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
87932024-11-27T18:41:13.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2260 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 608d9651-d42e-4e72-88ee-3bb287008c02 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
87942024-11-27T18:41:18.742ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1105 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 984fed62-7544-4091-8f07-af9ea61a836a response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
87952024-11-27T18:41:21.575ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
87962024-11-27T18:41:21.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
87972024-11-27T18:41:21.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87982024-11-27T18:41:21.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87992024-11-27T18:41:21.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88002024-11-27T18:41:21.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88012024-11-27T18:41:21.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88022024-11-27T18:41:21.578ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88032024-11-27T18:41:21.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88042024-11-27T18:41:21.580ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.65506ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88052024-11-27T18:41:21.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88062024-11-27T18:41:21.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88072024-11-27T18:41:21.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88082024-11-27T18:41:21.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88092024-11-27T18:41:21.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88102024-11-27T18:41:21.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88112024-11-27T18:41:21.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
88122024-11-27T18:41:21.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88132024-11-27T18:41:21.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88142024-11-27T18:41:21.623ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
88152024-11-27T18:41:21.623ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.043052ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
88162024-11-27T18:41:28.742ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1010 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = a30bcc66-fd90-4642-a6a2-36f851c94e2b response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
88172024-11-27T18:41:31.575ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
88182024-11-27T18:41:31.576ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
88192024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
88202024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
88212024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
88222024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
88232024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
88242024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88252024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
88262024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88272024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
88282024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
88292024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88302024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
88312024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
88322024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
88332024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88342024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
88352024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
88362024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
88372024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
88382024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
88392024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
88402024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
88412024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
88422024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88432024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
88442024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
88452024-11-27T18:41:31.576ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-27 18:31:31.576183193 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
88462024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
88472024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
88482024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88492024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
88502024-11-27T18:41:31.576ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
88512024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88522024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
88532024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
88542024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88552024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
88562024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
88572024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
88582024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
88592024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
88602024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
88612024-11-27T18:41:31.576ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 4ce244bc-1034-4855-877d-76a08bc15b71
88622024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.55\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"4ce244bc-1034-4855-877d-76a08bc15b71"}
88632024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
88642024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
88652024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
88662024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88672024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
88682024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
88692024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88702024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88712024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
88722024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
88732024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
88742024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
88752024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
88762024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
88772024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
88782024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88792024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88802024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
88812024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88822024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88832024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
88842024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88852024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
88862024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88872024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88882024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
88892024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
88902024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
88912024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88922024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
88932024-11-27T18:41:31.576ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f378a24-7578-4d72-8454-f489a3e51ffb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e203eafc-5cbd-4249-8d8a-770878ed4d6d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 2525, tv_nsec: 573567780 } })
88942024-11-27T18:41:31.576ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("923a7051-0539-4413-bab4-c2b0d3395fe2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2525, tv_nsec: 573583491 } })
88952024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88962024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
88972024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88982024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88992024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89002024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
89012024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89022024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
89032024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
89042024-11-27T18:41:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
89052024-11-27T18:41:31.577ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
89062024-11-27T18:41:31.577ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.274469ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
89072024-11-27T18:41:31.577ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
89082024-11-27T18:41:31.577ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.277398ms iteration = 9 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
89092024-11-27T18:41:31.577ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89102024-11-27T18:41:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89112024-11-27T18:41:31.579ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89122024-11-27T18:41:31.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89132024-11-27T18:41:31.580ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89142024-11-27T18:41:31.580ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
89152024-11-27T18:41:31.580ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89162024-11-27T18:41:31.580ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.841311ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
89172024-11-27T18:41:31.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89182024-11-27T18:41:31.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
89192024-11-27T18:41:31.581ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
89202024-11-27T18:41:31.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
89212024-11-27T18:41:31.581ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2525, tv_nsec: 578261530 } })
89222024-11-27T18:41:31.581ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
89232024-11-27T18:41:31.582ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2525, tv_nsec: 578908280 } })
89242024-11-27T18:41:31.582ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89252024-11-27T18:41:31.582ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
89262024-11-27T18:41:31.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89272024-11-27T18:41:31.583ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89282024-11-27T18:41:31.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
89292024-11-27T18:41:31.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89302024-11-27T18:41:31.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89312024-11-27T18:41:31.584ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
89322024-11-27T18:41:31.584ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89332024-11-27T18:41:31.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89342024-11-27T18:41:31.586ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89352024-11-27T18:41:31.587ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-27 18:31:31.576183193 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
89362024-11-27T18:41:31.587ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.349498ms iteration = 8 status = {"expiration":"2024-11-27T18:31:31.576183193Z","pruned":[]}
89372024-11-27T18:41:31.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
89382024-11-27T18:41:31.588ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89392024-11-27T18:41:31.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89402024-11-27T18:41:31.590ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89412024-11-27T18:41:31.591ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89422024-11-27T18:41:31.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
89432024-11-27T18:41:31.592ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
89442024-11-27T18:41:31.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
89452024-11-27T18:41:31.594ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
89462024-11-27T18:41:31.594ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89472024-11-27T18:41:31.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89482024-11-27T18:41:31.596ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89492024-11-27T18:41:31.597ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.401187ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
89502024-11-27T18:41:31.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
89512024-11-27T18:41:31.599ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89522024-11-27T18:41:31.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89532024-11-27T18:41:31.605ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89542024-11-27T18:41:31.606ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89552024-11-27T18:41:31.607ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89562024-11-27T18:41:31.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89572024-11-27T18:41:31.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89582024-11-27T18:41:31.607ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89592024-11-27T18:41:31.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89602024-11-27T18:41:31.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89612024-11-27T18:41:31.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89622024-11-27T18:41:31.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
89632024-11-27T18:41:31.611ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89642024-11-27T18:41:31.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89652024-11-27T18:41:31.630ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 54.156963ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
89662024-11-27T18:41:31.630ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89672024-11-27T18:41:31.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89682024-11-27T18:41:31.631ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
89692024-11-27T18:41:31.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89702024-11-27T18:41:31.633ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89712024-11-27T18:41:31.635ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
89722024-11-27T18:41:31.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
89732024-11-27T18:41:31.636ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
89742024-11-27T18:41:31.636ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89752024-11-27T18:41:31.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89762024-11-27T18:41:31.636ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 60.612169ms iteration = 15 status = {"errors":[],"records_set_to_done":[]}
89772024-11-27T18:41:31.638ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89782024-11-27T18:41:31.638ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
89792024-11-27T18:41:31.638ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
89802024-11-27T18:41:31.638ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 62.573637ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
89812024-11-27T18:41:31.640ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89822024-11-27T18:41:31.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
89832024-11-27T18:41:31.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
89842024-11-27T18:41:31.643ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89852024-11-27T18:41:31.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89862024-11-27T18:41:31.648ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2525, tv_nsec: 645653589 } })
89872024-11-27T18:41:31.649ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
89882024-11-27T18:41:31.653ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
89892024-11-27T18:41:31.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
89902024-11-27T18:41:31.654ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89912024-11-27T18:41:31.655ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89922024-11-27T18:41:31.655ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
89932024-11-27T18:41:31.655ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89942024-11-27T18:41:31.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89952024-11-27T18:41:31.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89962024-11-27T18:41:31.657ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89972024-11-27T18:41:31.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89982024-11-27T18:41:31.659ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
89992024-11-27T18:41:31.659ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
90002024-11-27T18:41:31.659ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
90012024-11-27T18:41:31.659ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
90022024-11-27T18:41:31.659ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90032024-11-27T18:41:31.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
90042024-11-27T18:41:31.660ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90052024-11-27T18:41:31.662ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
90062024-11-27T18:41:31.662ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90072024-11-27T18:41:31.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90082024-11-27T18:41:31.664ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
90092024-11-27T18:41:31.664ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90102024-11-27T18:41:31.664ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
90112024-11-27T18:41:31.664ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 87.776091ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
90122024-11-27T18:41:31.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90132024-11-27T18:41:31.665ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90142024-11-27T18:41:31.666ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 90.565023ms iteration = 15 status = 0
90152024-11-27T18:41:31.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
90162024-11-27T18:41:31.669ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
90172024-11-27T18:41:31.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
90182024-11-27T18:41:31.676ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
90192024-11-27T18:41:31.676ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
90202024-11-27T18:41:31.676ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 100.872785ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
90212024-11-27T18:41:31.678ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
90222024-11-27T18:41:31.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
90232024-11-27T18:41:31.682ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90242024-11-27T18:41:31.684ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 108.60613ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
90252024-11-27T18:41:31.684ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90262024-11-27T18:41:31.684ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
90272024-11-27T18:41:31.684ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90282024-11-27T18:41:31.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90292024-11-27T18:41:31.687ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 111.29605ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
90302024-11-27T18:41:31.688ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
90312024-11-27T18:41:31.688ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
90322024-11-27T18:41:31.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
90332024-11-27T18:41:31.693ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
90342024-11-27T18:41:31.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
90352024-11-27T18:41:31.696ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
90362024-11-27T18:41:31.696ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
90372024-11-27T18:41:31.696ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
90382024-11-27T18:41:31.696ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
90392024-11-27T18:41:31.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90402024-11-27T18:41:31.701ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
90412024-11-27T18:41:31.701ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
90422024-11-27T18:41:31.701ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
90432024-11-27T18:41:31.701ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 125.182555ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
90442024-11-27T18:41:31.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
90452024-11-27T18:41:31.702ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90462024-11-27T18:41:31.702ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
90472024-11-27T18:41:31.702ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 126.364363ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
90482024-11-27T18:41:31.702ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
90492024-11-27T18:41:31.710ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
90502024-11-27T18:41:31.715ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
90512024-11-27T18:41:31.715ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90522024-11-27T18:41:31.715ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "376c121b-761c-4af3-95ea-da249b7eab77", "content-length": "26", "date": "Wed, 27 Nov 2024 18:41:31 GMT"} })
90532024-11-27T18:41:31.715ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90542024-11-27T18:41:31.716ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
90552024-11-27T18:41:31.717ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90562024-11-27T18:41:31.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90572024-11-27T18:41:31.747ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
90582024-11-27T18:41:31.747ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 171.639294ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
90592024-11-27T18:41:31.752ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 175.772124ms iteration = 17 status = {"physical_disks_added":0}
90602024-11-27T18:41:31.762ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
90612024-11-27T18:41:31.762ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90622024-11-27T18:41:31.762ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "59cae023-4191-49fa-931b-c8dcd8daa229", "content-length": "26", "date": "Wed, 27 Nov 2024 18:41:31 GMT"} })
90632024-11-27T18:41:31.762ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90642024-11-27T18:41:31.765ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
90652024-11-27T18:41:31.821ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
90662024-11-27T18:41:31.821ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90672024-11-27T18:41:31.821ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0afde0a-275f-4b19-806b-1243c1e6d871", "content-length": "26", "date": "Wed, 27 Nov 2024 18:41:31 GMT"} })
90682024-11-27T18:41:31.821ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90692024-11-27T18:41:31.823ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
90702024-11-27T18:41:31.859ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
90712024-11-27T18:41:31.859ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "579e5da6-fcf5-43c9-b046-610f3d4be4c7", "date": "Wed, 27 Nov 2024 18:41:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
90722024-11-27T18:41:31.859ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
90732024-11-27T18:41:31.861ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "799c476b-f2ff-4893-8427-e4c76a40895b", "date": "Wed, 27 Nov 2024 18:41:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
90742024-11-27T18:41:31.861ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
90752024-11-27T18:41:31.862ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
90762024-11-27T18:41:31.862ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 286.599088ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
90772024-11-27T18:41:31.882ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
90782024-11-27T18:41:31.883ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
90792024-11-27T18:41:31.883ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
90802024-11-27T18:41:31.883ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a843e7ab-86fa-4ed5-9309-89025b33f0f1", "content-length": "372", "date": "Wed, 27 Nov 2024 18:41:31 GMT"} })
90812024-11-27T18:41:31.883ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90822024-11-27T18:41:31.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90832024-11-27T18:41:31.887ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90842024-11-27T18:41:31.887ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90852024-11-27T18:41:31.889ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
90862024-11-27T18:41:31.889ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90872024-11-27T18:41:31.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90882024-11-27T18:41:31.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
90892024-11-27T18:41:31.891ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
90902024-11-27T18:41:31.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
90912024-11-27T18:41:31.893ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
90922024-11-27T18:41:31.893ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
90932024-11-27T18:41:31.893ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-27 18:34:43.283070 UTC dns_group = internal generation = 1
90942024-11-27T18:41:31.893ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 317.619788ms iteration = 9 status = {"generation":1}
90952024-11-27T18:41:31.897ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
90962024-11-27T18:41:31.897ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 321.761089ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
90972024-11-27T18:41:31.900ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
90982024-11-27T18:41:31.900ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
90992024-11-27T18:41:31.900ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3f028fe1-9920-4af6-aaca-92a6a733fab5", "date": "Wed, 27 Nov 2024 18:41:31 GMT"} })
91002024-11-27T18:41:31.900ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91012024-11-27T18:41:31.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91022024-11-27T18:41:31.902ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91032024-11-27T18:41:31.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91042024-11-27T18:41:31.905ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91052024-11-27T18:41:31.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91062024-11-27T18:41:31.908ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
91072024-11-27T18:41:31.908ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
91082024-11-27T18:41:31.909ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "69c750ec-7f3f-4b1f-995d-5c673afafe31", "date": "Wed, 27 Nov 2024 18:41:31 GMT"} })
91092024-11-27T18:41:31.911ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 334.923244ms iteration = 16 status = {}
91102024-11-27T18:41:31.913ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91112024-11-27T18:41:31.914ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
91122024-11-27T18:41:31.914ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 337.930278ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
91132024-11-27T18:41:31.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
91142024-11-27T18:41:31.915ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91152024-11-27T18:41:31.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
91162024-11-27T18:41:31.916ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
91172024-11-27T18:41:31.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
91182024-11-27T18:41:31.917ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
91192024-11-27T18:41:31.917ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
91202024-11-27T18:41:31.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
91212024-11-27T18:41:31.921ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 345.37735ms iteration = 15 status = {}
91222024-11-27T18:41:31.921ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
91232024-11-27T18:41:31.921ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa160af1-9984-45fd-b5ad-a692652d751e", "content-length": "1", "date": "Wed, 27 Nov 2024 18:41:31 GMT"} })
91242024-11-27T18:41:31.927ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
91252024-11-27T18:41:31.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
91262024-11-27T18:41:31.928ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 352.690727ms iteration = 15 status = null
91272024-11-27T18:41:31.928ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91282024-11-27T18:41:31.931ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
91292024-11-27T18:41:31.931ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91302024-11-27T18:41:31.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91312024-11-27T18:41:31.951ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
91322024-11-27T18:41:31.951ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 0 version = 2
91332024-11-27T18:41:31.951ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
91342024-11-27T18:41:31.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
91352024-11-27T18:41:31.953ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-27T18:34:28.564237Z, time_modified: 2024-11-27T18:34:28.564237Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }) }
91362024-11-27T18:41:31.953ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 377.224511ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]}},"default_endpoint":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
91372024-11-27T18:41:31.975ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
91382024-11-27T18:41:31.976ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "52f0915c-b88f-4fd7-8dd2-83de0b02c5e9", "date": "Wed, 27 Nov 2024 18:41:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
91392024-11-27T18:41:31.976ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
91402024-11-27T18:41:31.978ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "15dea21b-b22b-46b0-a693-9f7cf854977e", "date": "Wed, 27 Nov 2024 18:41:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
91412024-11-27T18:41:31.978ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
91422024-11-27T18:41:31.980ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "f7d0b0a2-e2b9-4190-895d-22066a1b8ab0", "date": "Wed, 27 Nov 2024 18:41:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
91432024-11-27T18:41:31.980ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
91442024-11-27T18:41:31.983ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
91452024-11-27T18:41:31.983ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 407.183255ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
91462024-11-27T18:41:31.986ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91472024-11-27T18:41:31.991ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
91482024-11-27T18:41:31.991ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
91492024-11-27T18:41:31.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
91502024-11-27T18:41:31.994ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 1 version = 2
91512024-11-27T18:41:31.994ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
91522024-11-27T18:41:31.994ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-27 18:34:44.388958 UTC dns_group = external generation = 2
91532024-11-27T18:41:31.994ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 418.29328ms iteration = 9 status = {"generation":2}
91542024-11-27T18:41:32.093ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91552024-11-27T18:41:32.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91562024-11-27T18:41:32.094ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
91572024-11-27T18:41:32.094ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91582024-11-27T18:41:32.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91592024-11-27T18:41:32.098ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
91602024-11-27T18:41:32.099ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6af90547-fb3e-4bdb-9efd-bae69e9b4546", "content-length": "691", "date": "Wed, 27 Nov 2024 18:41:32 GMT"} })
91612024-11-27T18:41:32.099ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
91622024-11-27T18:41:32.099ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
91632024-11-27T18:41:32.099ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
91642024-11-27T18:41:32.101ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 524.9437ms iteration = 15 status = {}
91652024-11-27T18:41:32.105ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
91662024-11-27T18:41:32.105ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca42a0a8-a77c-42f6-a2c0-8f520c536b89", "content-length": "134", "date": "Wed, 27 Nov 2024 18:41:31 GMT"} })
91672024-11-27T18:41:32.105ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
91682024-11-27T18:41:32.105ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
91692024-11-27T18:41:32.105ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
91702024-11-27T18:41:32.105ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
91712024-11-27T18:41:32.105ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91722024-11-27T18:41:32.105ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91732024-11-27T18:41:32.105ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91742024-11-27T18:41:32.105ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
91752024-11-27T18:41:32.106ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91762024-11-27T18:41:32.106ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
91772024-11-27T18:41:32.106ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
91782024-11-27T18:41:32.106ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91792024-11-27T18:41:32.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91802024-11-27T18:41:32.107ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
91812024-11-27T18:41:32.108ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "da296537-384d-4d2f-b87b-0d95ab8b368d", "content-length": "2", "date": "Wed, 27 Nov 2024 18:41:31 GMT"} })
91822024-11-27T18:41:32.108ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
91832024-11-27T18:41:32.108ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "75cb8f6e-ca07-4c14-b020-877e9bfc9c60", "content-length": "52", "date": "Wed, 27 Nov 2024 18:41:31 GMT"} })
91842024-11-27T18:41:32.108ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
91852024-11-27T18:41:32.108ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
91862024-11-27T18:41:32.196ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5347b66c-4a3a-48ae-aa43-7cfe6c8cc8e9", "date": "Wed, 27 Nov 2024 18:41:32 GMT"} })
91872024-11-27T18:41:32.196ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
91882024-11-27T18:41:32.196ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
91892024-11-27T18:41:32.196ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "bdc174ce-018f-4cb1-b491-c28d2a6f7c8a", "content-length": "682", "date": "Wed, 27 Nov 2024 18:41:32 GMT"} })
91902024-11-27T18:41:32.196ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91912024-11-27T18:41:32.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91922024-11-27T18:41:32.200ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91932024-11-27T18:41:32.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91942024-11-27T18:41:32.204ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91952024-11-27T18:41:32.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91962024-11-27T18:41:32.207ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91972024-11-27T18:41:32.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91982024-11-27T18:41:32.214ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 638.122699ms iteration = 15 status = {}
91992024-11-27T18:41:38.742ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1190 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = dc71af0a-adac-4667-9b92-901d983dd432 response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
92002024-11-27T18:41:41.575ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
92012024-11-27T18:41:41.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
92022024-11-27T18:41:41.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92032024-11-27T18:41:41.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92042024-11-27T18:41:41.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92052024-11-27T18:41:41.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92062024-11-27T18:41:41.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92072024-11-27T18:41:41.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92082024-11-27T18:41:41.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92092024-11-27T18:41:41.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92102024-11-27T18:41:41.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92112024-11-27T18:41:41.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92122024-11-27T18:41:41.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92132024-11-27T18:41:41.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92142024-11-27T18:41:41.616ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92152024-11-27T18:41:41.618ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
92162024-11-27T18:41:41.618ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92172024-11-27T18:41:41.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92182024-11-27T18:41:41.627ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
92192024-11-27T18:41:41.628ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.234904ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
92202024-11-27T18:41:41.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.457551ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
92212024-11-27T18:41:48.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1352 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 488656f4-6af8-463d-9d1a-8df9b5a063d3 response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
92222024-11-27T18:41:51.575ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
92232024-11-27T18:41:51.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92242024-11-27T18:41:51.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
92252024-11-27T18:41:51.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92262024-11-27T18:41:51.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92272024-11-27T18:41:51.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92282024-11-27T18:41:51.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92292024-11-27T18:41:51.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92302024-11-27T18:41:51.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92312024-11-27T18:41:51.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92322024-11-27T18:41:51.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92332024-11-27T18:41:51.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92342024-11-27T18:41:51.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92352024-11-27T18:41:51.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
92362024-11-27T18:41:51.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92372024-11-27T18:41:51.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92382024-11-27T18:41:51.595ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
92392024-11-27T18:41:51.595ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.158769ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
92402024-11-27T18:41:51.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92412024-11-27T18:41:51.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92422024-11-27T18:41:51.607ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.239113ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
92432024-11-27T18:41:58.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1538 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 8ca07da2-66fc-4e9b-8c9b-8f3dc8340f7b response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
92442024-11-27T18:42:01.575ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
92452024-11-27T18:42:01.575ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
92462024-11-27T18:42:01.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92472024-11-27T18:42:01.575ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92482024-11-27T18:42:01.575ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
92492024-11-27T18:42:01.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
92502024-11-27T18:42:01.575ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
92512024-11-27T18:42:01.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
92522024-11-27T18:42:01.575ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
92532024-11-27T18:42:01.575ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
92542024-11-27T18:42:01.575ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
92552024-11-27T18:42:01.575ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
92562024-11-27T18:42:01.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92572024-11-27T18:42:01.575ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
92582024-11-27T18:42:01.576ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
92592024-11-27T18:42:01.576ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
92602024-11-27T18:42:01.576ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
92612024-11-27T18:42:01.576ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
92622024-11-27T18:42:01.576ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92632024-11-27T18:42:01.576ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
92642024-11-27T18:42:01.576ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92652024-11-27T18:42:01.576ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
92662024-11-27T18:42:01.576ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92672024-11-27T18:42:01.576ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
92682024-11-27T18:42:01.576ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
92692024-11-27T18:42:01.576ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
92702024-11-27T18:42:01.576ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
92712024-11-27T18:42:01.576ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
92722024-11-27T18:42:01.576ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
92732024-11-27T18:42:01.576ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
92742024-11-27T18:42:01.576ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
92752024-11-27T18:42:01.576ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
92762024-11-27T18:42:01.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92772024-11-27T18:42:01.576ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
92782024-11-27T18:42:01.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
92792024-11-27T18:42:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92802024-11-27T18:42:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
92812024-11-27T18:42:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92822024-11-27T18:42:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92832024-11-27T18:42:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92842024-11-27T18:42:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
92852024-11-27T18:42:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
92862024-11-27T18:42:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92872024-11-27T18:42:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92882024-11-27T18:42:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
92892024-11-27T18:42:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
92902024-11-27T18:42:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
92912024-11-27T18:42:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
92922024-11-27T18:42:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92932024-11-27T18:42:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
92942024-11-27T18:42:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92952024-11-27T18:42:01.578ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92962024-11-27T18:42:01.578ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
92972024-11-27T18:42:01.578ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.064865ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
92982024-11-27T18:42:01.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
92992024-11-27T18:42:01.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93002024-11-27T18:42:01.580ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93012024-11-27T18:42:01.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
93022024-11-27T18:42:01.580ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93032024-11-27T18:42:01.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93042024-11-27T18:42:01.582ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93052024-11-27T18:42:01.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
93062024-11-27T18:42:01.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93072024-11-27T18:42:01.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93082024-11-27T18:42:01.583ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2555, tv_nsec: 579798433 } })
93092024-11-27T18:42:01.583ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
93102024-11-27T18:42:01.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
93112024-11-27T18:42:01.583ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93122024-11-27T18:42:01.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93132024-11-27T18:42:01.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
93142024-11-27T18:42:01.584ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
93152024-11-27T18:42:01.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
93162024-11-27T18:42:01.585ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2555, tv_nsec: 582523184 } })
93172024-11-27T18:42:01.586ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
93182024-11-27T18:42:01.586ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.588427ms iteration = 16 status = {"errors":[],"records_set_to_done":[]}
93192024-11-27T18:42:01.587ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93202024-11-27T18:42:01.588ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93212024-11-27T18:42:01.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93222024-11-27T18:42:01.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
93232024-11-27T18:42:01.589ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93242024-11-27T18:42:01.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93252024-11-27T18:42:01.590ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
93262024-11-27T18:42:01.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
93272024-11-27T18:42:01.592ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93282024-11-27T18:42:01.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93292024-11-27T18:42:01.592ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93302024-11-27T18:42:01.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93312024-11-27T18:42:01.593ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 17.463939ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
93322024-11-27T18:42:01.595ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93332024-11-27T18:42:01.598ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93342024-11-27T18:42:01.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93352024-11-27T18:42:01.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
93362024-11-27T18:42:01.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93372024-11-27T18:42:01.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93382024-11-27T18:42:01.604ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2555, tv_nsec: 601009907 } })
93392024-11-27T18:42:01.604ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
93402024-11-27T18:42:01.615ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
93412024-11-27T18:42:01.615ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 39.77585ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
93422024-11-27T18:42:01.624ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93432024-11-27T18:42:01.624ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
93442024-11-27T18:42:01.624ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93452024-11-27T18:42:01.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93462024-11-27T18:42:01.625ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93472024-11-27T18:42:01.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93482024-11-27T18:42:01.626ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
93492024-11-27T18:42:01.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
93502024-11-27T18:42:01.626ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 50.896994ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
93512024-11-27T18:42:01.627ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93522024-11-27T18:42:01.627ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93532024-11-27T18:42:01.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93542024-11-27T18:42:01.629ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93552024-11-27T18:42:01.629ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
93562024-11-27T18:42:01.629ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93572024-11-27T18:42:01.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93582024-11-27T18:42:01.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93592024-11-27T18:42:01.629ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93602024-11-27T18:42:01.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93612024-11-27T18:42:01.632ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93622024-11-27T18:42:01.634ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
93632024-11-27T18:42:01.634ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93642024-11-27T18:42:01.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93652024-11-27T18:42:01.636ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 60.774621ms iteration = 16 status = 0
93662024-11-27T18:42:01.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 61.870228ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
93672024-11-27T18:42:01.638ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93682024-11-27T18:42:01.641ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
93692024-11-27T18:42:01.641ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 65.190226ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
93702024-11-27T18:42:01.641ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
93712024-11-27T18:42:01.641ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93722024-11-27T18:42:01.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93732024-11-27T18:42:01.652ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93742024-11-27T18:42:01.652ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
93752024-11-27T18:42:01.652ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93762024-11-27T18:42:01.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93772024-11-27T18:42:01.655ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 79.331766ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
93782024-11-27T18:42:01.665ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 89.386465ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
93792024-11-27T18:42:01.670ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93802024-11-27T18:42:01.670ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
93812024-11-27T18:42:01.670ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93822024-11-27T18:42:01.670ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "53bff4f5-4331-49f9-9f9d-10be6a98366b", "content-length": "26", "date": "Wed, 27 Nov 2024 18:42:01 GMT"} })
93832024-11-27T18:42:01.670ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93842024-11-27T18:42:01.671ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
93852024-11-27T18:42:01.671ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93862024-11-27T18:42:01.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93872024-11-27T18:42:01.672ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
93882024-11-27T18:42:01.673ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
93892024-11-27T18:42:01.673ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93902024-11-27T18:42:01.674ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3296cab-940b-4dd1-b128-d1b07c9f6244", "content-length": "26", "date": "Wed, 27 Nov 2024 18:42:01 GMT"} })
93912024-11-27T18:42:01.674ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93922024-11-27T18:42:01.675ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
93932024-11-27T18:42:01.695ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93942024-11-27T18:42:01.695ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
93952024-11-27T18:42:01.695ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 119.812586ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
93962024-11-27T18:42:01.714ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
93972024-11-27T18:42:01.714ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93982024-11-27T18:42:01.714ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d296e03-0c52-4421-bf88-5c0ab09afcb0", "content-length": "26", "date": "Wed, 27 Nov 2024 18:42:01 GMT"} })
93992024-11-27T18:42:01.714ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94002024-11-27T18:42:01.717ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
94012024-11-27T18:42:01.732ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94022024-11-27T18:42:01.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94032024-11-27T18:42:01.733ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94042024-11-27T18:42:01.735ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
94052024-11-27T18:42:01.735ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94062024-11-27T18:42:01.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94072024-11-27T18:42:01.748ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 172.532648ms iteration = 18 status = {"physical_disks_added":0}
94082024-11-27T18:42:01.772ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
94092024-11-27T18:42:01.772ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "edece2e9-4dae-4e60-b999-0225efaa0123", "content-length": "1", "date": "Wed, 27 Nov 2024 18:42:00 GMT"} })
94102024-11-27T18:42:01.774ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
94112024-11-27T18:42:01.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
94122024-11-27T18:42:01.837ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
94132024-11-27T18:42:01.837ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
94142024-11-27T18:42:01.837ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f30005f-667d-46f6-aef8-c4a3976b32aa", "content-length": "372", "date": "Wed, 27 Nov 2024 18:42:01 GMT"} })
94152024-11-27T18:42:01.837ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94162024-11-27T18:42:01.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94172024-11-27T18:42:01.839ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 263.686828ms iteration = 16 status = null
94182024-11-27T18:42:01.839ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 263.787939ms iteration = 16 status = {}
94192024-11-27T18:42:01.870ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94202024-11-27T18:42:01.872ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
94212024-11-27T18:42:01.872ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94222024-11-27T18:42:01.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94232024-11-27T18:42:01.882ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
94242024-11-27T18:42:01.882ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
94252024-11-27T18:42:01.883ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1a02b167-1e65-4adc-a54b-0629a0153d6b", "date": "Wed, 27 Nov 2024 18:42:01 GMT"} })
94262024-11-27T18:42:01.883ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94272024-11-27T18:42:01.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94282024-11-27T18:42:01.885ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94292024-11-27T18:42:01.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94302024-11-27T18:42:01.889ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94312024-11-27T18:42:01.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94322024-11-27T18:42:01.892ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
94332024-11-27T18:42:01.892ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
94342024-11-27T18:42:01.893ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a9cdc309-d2ba-4070-963e-c3ea29719d2c", "date": "Wed, 27 Nov 2024 18:42:01 GMT"} })
94352024-11-27T18:42:01.894ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 318.813685ms iteration = 17 status = {}
94362024-11-27T18:42:01.914ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94372024-11-27T18:42:01.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94382024-11-27T18:42:01.915ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
94392024-11-27T18:42:01.915ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94402024-11-27T18:42:01.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94412024-11-27T18:42:01.925ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
94422024-11-27T18:42:01.925ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "53ce3dbe-3f24-4ec1-b577-74f824d8a446", "content-length": "134", "date": "Wed, 27 Nov 2024 18:42:01 GMT"} })
94432024-11-27T18:42:01.925ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
94442024-11-27T18:42:01.925ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
94452024-11-27T18:42:01.926ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
94462024-11-27T18:42:01.926ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
94472024-11-27T18:42:01.926ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94482024-11-27T18:42:01.926ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94492024-11-27T18:42:01.926ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94502024-11-27T18:42:01.926ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
94512024-11-27T18:42:01.926ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94522024-11-27T18:42:01.926ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
94532024-11-27T18:42:01.926ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
94542024-11-27T18:42:01.926ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94552024-11-27T18:42:01.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94562024-11-27T18:42:01.928ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
94572024-11-27T18:42:01.928ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "751bb920-9845-451f-81fc-dc1b7decd0cd", "content-length": "2", "date": "Wed, 27 Nov 2024 18:42:01 GMT"} })
94582024-11-27T18:42:01.928ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
94592024-11-27T18:42:01.928ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce932685-834e-43ab-8761-92205384ef44", "content-length": "52", "date": "Wed, 27 Nov 2024 18:42:01 GMT"} })
94602024-11-27T18:42:01.928ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
94612024-11-27T18:42:01.928ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
94622024-11-27T18:42:01.957ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
94632024-11-27T18:42:02.030ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1a6ff28d-f4fb-4e13-9f2b-22f2046a9eae", "date": "Wed, 27 Nov 2024 18:42:01 GMT"} })
94642024-11-27T18:42:02.030ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
94652024-11-27T18:42:02.030ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
94662024-11-27T18:42:02.030ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b566bf8-8251-44a3-83f8-91eab7d15079", "content-length": "691", "date": "Wed, 27 Nov 2024 18:42:01 GMT"} })
94672024-11-27T18:42:02.030ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
94682024-11-27T18:42:02.030ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
94692024-11-27T18:42:02.030ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
94702024-11-27T18:42:02.030ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b53788d0-86aa-4713-9863-5a14c4204573", "content-length": "682", "date": "Wed, 27 Nov 2024 18:42:01 GMT"} })
94712024-11-27T18:42:02.030ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94722024-11-27T18:42:02.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94732024-11-27T18:42:02.031ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 455.922048ms iteration = 16 status = {}
94742024-11-27T18:42:02.034ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94752024-11-27T18:42:02.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94762024-11-27T18:42:02.037ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94772024-11-27T18:42:02.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94782024-11-27T18:42:02.039ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94792024-11-27T18:42:02.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94802024-11-27T18:42:02.046ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 470.808358ms iteration = 16 status = {}
94812024-11-27T18:42:06.271ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:63989
94822024-11-27T18:42:06.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63989 req_id = a6d8c1bd-04fb-49c6-b940-e2aa5e4c7e57 roles = RoleSet { roles: {} } uri = /metrics/producers
94832024-11-27T18:42:06.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63989 req_id = a6d8c1bd-04fb-49c6-b940-e2aa5e4c7e57 resource = Database result = Ok(()) uri = /metrics/producers
94842024-11-27T18:42:06.308ZINFOnexus: assigned collector to new producer collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:76 producer_id = 89a52276-2829-4963-a094-8143be2c1bad
94852024-11-27T18:42:06.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37125 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63989 req_id = a6d8c1bd-04fb-49c6-b940-e2aa5e4c7e57 response_code = 201 uri = /metrics/producers
94862024-11-27T18:42:08.742ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1153 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 4267af56-f0fb-40b5-bfe0-d3bd73cf6ce4 response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
94872024-11-27T18:42:10.205ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:46179
94882024-11-27T18:42:10.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46179 req_id = 7c42e8bb-5588-47d0-b1e5-b4872aef64aa roles = RoleSet { roles: {} } uri = /metrics/producers
94892024-11-27T18:42:10.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46179 req_id = 7c42e8bb-5588-47d0-b1e5-b4872aef64aa resource = Database result = Ok(()) uri = /metrics/producers
94902024-11-27T18:42:10.240ZINFOnexus: assigned collector to new producer collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:76 producer_id = b903b497-e034-4c1d-8f82-b6e6cc8f7a53
94912024-11-27T18:42:10.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35472 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46179 req_id = 7c42e8bb-5588-47d0-b1e5-b4872aef64aa response_code = 201 uri = /metrics/producers
94922024-11-27T18:42:11.575ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
94932024-11-27T18:42:11.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
94942024-11-27T18:42:11.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94952024-11-27T18:42:11.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94962024-11-27T18:42:11.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94972024-11-27T18:42:11.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94982024-11-27T18:42:11.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94992024-11-27T18:42:11.577ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95002024-11-27T18:42:11.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95012024-11-27T18:42:11.579ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.638744ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
95022024-11-27T18:42:11.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
95032024-11-27T18:42:11.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95042024-11-27T18:42:11.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95052024-11-27T18:42:11.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95062024-11-27T18:42:11.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95072024-11-27T18:42:11.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95082024-11-27T18:42:11.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
95092024-11-27T18:42:11.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95102024-11-27T18:42:11.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95112024-11-27T18:42:11.597ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
95122024-11-27T18:42:11.597ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.159308ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
95132024-11-27T18:42:15.054ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
95142024-11-27T18:42:15.054ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
95152024-11-27T18:42:15.086ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
95162024-11-27T18:42:15.087ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:55764
95172024-11-27T18:42:15.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:55764 req_id = 0deee3be-1319-4c31-bbdc-b11ad3b3d5f1 roles = RoleSet { roles: {} } uri = /metrics/producers
95182024-11-27T18:42:15.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:55764 req_id = 0deee3be-1319-4c31-bbdc-b11ad3b3d5f1 resource = Database result = Ok(()) uri = /metrics/producers
95192024-11-27T18:42:15.124ZINFOnexus: assigned collector to new producer collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:76 producer_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
95202024-11-27T18:42:15.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37021 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:55764 req_id = 0deee3be-1319-4c31-bbdc-b11ad3b3d5f1 response_code = 201 uri = /metrics/producers
95212024-11-27T18:42:15.124ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "0deee3be-1319-4c31-bbdc-b11ad3b3d5f1", "content-length": "41", "date": "Wed, 27 Nov 2024 18:42:15 GMT"} })
95222024-11-27T18:42:15.125ZDEBGnexus (producer-registration-task): registered with nexus successfully
95232024-11-27T18:42:15.125ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
95242024-11-27T18:42:18.742ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1001 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = d2c676e9-98de-4694-b57e-a4c1999ff57b response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
95252024-11-27T18:42:21.576ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
95262024-11-27T18:42:21.576ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
95272024-11-27T18:42:21.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95282024-11-27T18:42:21.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95292024-11-27T18:42:21.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95302024-11-27T18:42:21.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95312024-11-27T18:42:21.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95322024-11-27T18:42:21.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
95332024-11-27T18:42:21.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95342024-11-27T18:42:21.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95352024-11-27T18:42:21.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95362024-11-27T18:42:21.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95372024-11-27T18:42:21.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95382024-11-27T18:42:21.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
95392024-11-27T18:42:21.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95402024-11-27T18:42:21.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95412024-11-27T18:42:21.598ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
95422024-11-27T18:42:21.598ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.126568ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
95432024-11-27T18:42:21.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95442024-11-27T18:42:21.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95452024-11-27T18:42:21.607ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.03026ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
95462024-11-27T18:42:24.177ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:64004
95472024-11-27T18:42:24.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64004 req_id = d800a38d-cc35-4542-9c02-e4f680c200e7 roles = RoleSet { roles: {} } uri = /metrics/producers
95482024-11-27T18:42:24.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64004 req_id = d800a38d-cc35-4542-9c02-e4f680c200e7 resource = Database result = Ok(()) uri = /metrics/producers
95492024-11-27T18:42:24.187ZINFOnexus: assigned collector to new producer collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:76 producer_id = 761834fc-a72f-4e26-9e1f-c4047ccf5da9
95502024-11-27T18:42:24.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10332 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64004 req_id = d800a38d-cc35-4542-9c02-e4f680c200e7 response_code = 201 uri = /metrics/producers
95512024-11-27T18:42:27.162ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:54282
95522024-11-27T18:42:27.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54282 req_id = 6b5ef619-199e-401e-a80f-329f42b9c856 roles = RoleSet { roles: {} } uri = /metrics/producers
95532024-11-27T18:42:27.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54282 req_id = 6b5ef619-199e-401e-a80f-329f42b9c856 resource = Database result = Ok(()) uri = /metrics/producers
95542024-11-27T18:42:27.173ZINFOnexus: assigned collector to new producer collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:76 producer_id = f3f7f234-938f-4eb4-84cd-9acd73e59924
95552024-11-27T18:42:27.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11075 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54282 req_id = 6b5ef619-199e-401e-a80f-329f42b9c856 response_code = 201 uri = /metrics/producers
95562024-11-27T18:42:28.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = d6243552-f141-4a46-85f5-ea4c29a5c71c roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
95572024-11-27T18:42:28.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = d6243552-f141-4a46-85f5-ea4c29a5c71c resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
95582024-11-27T18:42:28.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2940 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = d6243552-f141-4a46-85f5-ea4c29a5c71c response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
95592024-11-27T18:42:28.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = e5d1c167-7e95-455a-8cf3-ebd05e48f2d3 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
95602024-11-27T18:42:28.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = e5d1c167-7e95-455a-8cf3-ebd05e48f2d3 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
95612024-11-27T18:42:28.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2416 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = e5d1c167-7e95-455a-8cf3-ebd05e48f2d3 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
95622024-11-27T18:42:28.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1755 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = af1d239f-c17c-42a5-9ce9-8dd390483b9d response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
95632024-11-27T18:42:30.959ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:47149
95642024-11-27T18:42:30.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47149 req_id = 97ed07e4-7317-41cb-a6be-27923515649e roles = RoleSet { roles: {} } uri = /metrics/producers
95652024-11-27T18:42:30.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47149 req_id = 97ed07e4-7317-41cb-a6be-27923515649e resource = Database result = Ok(()) uri = /metrics/producers
95662024-11-27T18:42:30.994ZINFOnexus: assigned collector to new producer collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:76 producer_id = b844cfb5-ff43-41f6-a61d-f7949f48466b
95672024-11-27T18:42:30.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34486 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47149 req_id = 97ed07e4-7317-41cb-a6be-27923515649e response_code = 201 uri = /metrics/producers
95682024-11-27T18:42:31.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
95692024-11-27T18:42:31.575ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
95702024-11-27T18:42:31.575ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
95712024-11-27T18:42:31.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
95722024-11-27T18:42:31.575ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
95732024-11-27T18:42:31.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
95742024-11-27T18:42:31.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
95752024-11-27T18:42:31.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
95762024-11-27T18:42:31.575ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
95772024-11-27T18:42:31.575ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
95782024-11-27T18:42:31.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
95792024-11-27T18:42:31.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
95802024-11-27T18:42:31.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
95812024-11-27T18:42:31.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
95822024-11-27T18:42:31.575ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
95832024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95842024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
95852024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
95862024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
95872024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
95882024-11-27T18:42:31.576ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-27 18:32:31.575960706 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
95892024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
95902024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
95912024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
95922024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
95932024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
95942024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
95952024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
95962024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
95972024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
95982024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
95992024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
96002024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96012024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
96022024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
96032024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
96042024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
96052024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
96062024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96072024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
96082024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
96092024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
96102024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
96112024-11-27T18:42:31.576ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
96122024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
96132024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
96142024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
96152024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
96162024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96172024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
96182024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
96192024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
96202024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
96212024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
96222024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
96232024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96242024-11-27T18:42:31.576ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
96252024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96262024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
96272024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
96282024-11-27T18:42:31.576ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 4ce244bc-1034-4855-877d-76a08bc15b71
96292024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
96302024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.13\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"4ce244bc-1034-4855-877d-76a08bc15b71"}
96312024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96322024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
96332024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
96342024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
96352024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
96362024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
96372024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
96382024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
96392024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
96402024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
96412024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
96422024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96432024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
96442024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
96452024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
96462024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
96472024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96482024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96492024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
96502024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
96512024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
96522024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96532024-11-27T18:42:31.576ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("923a7051-0539-4413-bab4-c2b0d3395fe2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2585, tv_nsec: 573206065 } })
96542024-11-27T18:42:31.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96552024-11-27T18:42:31.576ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f378a24-7578-4d72-8454-f489a3e51ffb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e203eafc-5cbd-4249-8d8a-770878ed4d6d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 2585, tv_nsec: 573273026 } })
96562024-11-27T18:42:31.577ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
96572024-11-27T18:42:31.577ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
96582024-11-27T18:42:31.577ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.27827ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
96592024-11-27T18:42:31.577ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
96602024-11-27T18:42:31.577ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.379181ms iteration = 10 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
96612024-11-27T18:42:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
96622024-11-27T18:42:31.578ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96632024-11-27T18:42:31.579ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.665774ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
96642024-11-27T18:42:31.579ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2585, tv_nsec: 576331032 } })
96652024-11-27T18:42:31.580ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
96662024-11-27T18:42:31.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
96672024-11-27T18:42:31.581ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96682024-11-27T18:42:31.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96692024-11-27T18:42:31.583ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
96702024-11-27T18:42:31.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
96712024-11-27T18:42:31.584ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.209261ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
96722024-11-27T18:42:31.584ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-27 18:32:31.575960706 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
96732024-11-27T18:42:31.584ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.666349ms iteration = 9 status = {"expiration":"2024-11-27T18:32:31.575960706Z","pruned":[]}
96742024-11-27T18:42:31.585ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96752024-11-27T18:42:31.586ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96762024-11-27T18:42:31.587ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
96772024-11-27T18:42:31.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
96782024-11-27T18:42:31.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
96792024-11-27T18:42:31.588ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
96802024-11-27T18:42:31.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
96812024-11-27T18:42:31.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
96822024-11-27T18:42:31.589ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
96832024-11-27T18:42:31.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
96842024-11-27T18:42:31.596ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2585, tv_nsec: 593386904 } })
96852024-11-27T18:42:31.597ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
96862024-11-27T18:42:31.598ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96872024-11-27T18:42:31.598ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96882024-11-27T18:42:31.600ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96892024-11-27T18:42:31.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96902024-11-27T18:42:31.601ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
96912024-11-27T18:42:31.601ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96922024-11-27T18:42:31.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96932024-11-27T18:42:31.602ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
96942024-11-27T18:42:31.604ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 28.413181ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
96952024-11-27T18:42:31.623ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96962024-11-27T18:42:31.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96972024-11-27T18:42:31.625ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
96982024-11-27T18:42:31.625ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
96992024-11-27T18:42:31.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97002024-11-27T18:42:31.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97012024-11-27T18:42:31.627ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 51.643505ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
97022024-11-27T18:42:31.627ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97032024-11-27T18:42:31.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97042024-11-27T18:42:31.631ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97052024-11-27T18:42:31.632ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97062024-11-27T18:42:31.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
97072024-11-27T18:42:31.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
97082024-11-27T18:42:31.633ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97092024-11-27T18:42:31.633ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
97102024-11-27T18:42:31.633ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97112024-11-27T18:42:31.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97122024-11-27T18:42:31.634ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
97132024-11-27T18:42:31.634ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97142024-11-27T18:42:31.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97152024-11-27T18:42:31.635ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
97162024-11-27T18:42:31.635ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97172024-11-27T18:42:31.635ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 59.476522ms iteration = 17 status = {"errors":[],"records_set_to_done":[]}
97182024-11-27T18:42:31.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97192024-11-27T18:42:31.644ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 68.015268ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
97202024-11-27T18:42:31.646ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97212024-11-27T18:42:31.648ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2585, tv_nsec: 645237643 } })
97222024-11-27T18:42:31.649ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
97232024-11-27T18:42:31.650ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
97242024-11-27T18:42:31.652ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97252024-11-27T18:42:31.653ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 76.91013ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
97262024-11-27T18:42:31.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97272024-11-27T18:42:31.653ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97282024-11-27T18:42:31.653ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
97292024-11-27T18:42:31.653ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
97302024-11-27T18:42:31.653ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 77.844863ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
97312024-11-27T18:42:31.654ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97322024-11-27T18:42:31.655ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97332024-11-27T18:42:31.656ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97342024-11-27T18:42:31.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97352024-11-27T18:42:31.657ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97362024-11-27T18:42:31.657ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97372024-11-27T18:42:31.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97382024-11-27T18:42:31.658ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
97392024-11-27T18:42:31.658ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97402024-11-27T18:42:31.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97412024-11-27T18:42:31.658ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
97422024-11-27T18:42:31.659ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
97432024-11-27T18:42:31.659ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
97442024-11-27T18:42:31.659ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
97452024-11-27T18:42:31.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
97462024-11-27T18:42:31.659ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
97472024-11-27T18:42:31.659ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97482024-11-27T18:42:31.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97492024-11-27T18:42:31.660ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
97502024-11-27T18:42:31.660ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
97512024-11-27T18:42:31.660ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
97522024-11-27T18:42:31.660ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
97532024-11-27T18:42:31.660ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 84.29679ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
97542024-11-27T18:42:31.660ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 84.34245ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
97552024-11-27T18:42:31.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
97562024-11-27T18:42:31.662ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97572024-11-27T18:42:31.662ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97582024-11-27T18:42:31.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97592024-11-27T18:42:31.663ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97602024-11-27T18:42:31.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97612024-11-27T18:42:31.665ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97622024-11-27T18:42:31.665ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97632024-11-27T18:42:31.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97642024-11-27T18:42:31.667ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97652024-11-27T18:42:31.668ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97662024-11-27T18:42:31.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
97672024-11-27T18:42:31.671ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97682024-11-27T18:42:31.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97692024-11-27T18:42:31.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
97702024-11-27T18:42:31.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97712024-11-27T18:42:31.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97722024-11-27T18:42:31.674ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 99.134069ms iteration = 17 status = 0
97732024-11-27T18:42:31.678ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97742024-11-27T18:42:31.680ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
97752024-11-27T18:42:31.680ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97762024-11-27T18:42:31.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97772024-11-27T18:42:31.685ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
97782024-11-27T18:42:31.685ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 109.062737ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
97792024-11-27T18:42:31.686ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97802024-11-27T18:42:31.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97812024-11-27T18:42:31.693ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97822024-11-27T18:42:31.693ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
97832024-11-27T18:42:31.693ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97842024-11-27T18:42:31.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97852024-11-27T18:42:31.709ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97862024-11-27T18:42:31.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97872024-11-27T18:42:31.710ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
97882024-11-27T18:42:31.710ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
97892024-11-27T18:42:31.710ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
97902024-11-27T18:42:31.710ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
97912024-11-27T18:42:31.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
97922024-11-27T18:42:31.712ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97932024-11-27T18:42:31.712ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97942024-11-27T18:42:31.715ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
97952024-11-27T18:42:31.715ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97962024-11-27T18:42:31.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97972024-11-27T18:42:31.715ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
97982024-11-27T18:42:31.717ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
97992024-11-27T18:42:31.717ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98002024-11-27T18:42:31.717ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98012024-11-27T18:42:31.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98022024-11-27T18:42:31.721ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
98032024-11-27T18:42:31.721ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98042024-11-27T18:42:31.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98052024-11-27T18:42:31.724ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
98062024-11-27T18:42:31.724ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98072024-11-27T18:42:31.724ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b96197fc-44b2-48a8-8d54-9e503f946f5e", "content-length": "26", "date": "Wed, 27 Nov 2024 18:42:31 GMT"} })
98082024-11-27T18:42:31.724ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98092024-11-27T18:42:31.724ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
98102024-11-27T18:42:31.727ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
98112024-11-27T18:42:31.730ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 155.089518ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
98122024-11-27T18:42:31.731ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
98132024-11-27T18:42:31.731ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98142024-11-27T18:42:31.731ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0982e30-e2ba-4031-8cbb-428233da9b87", "content-length": "26", "date": "Wed, 27 Nov 2024 18:42:31 GMT"} })
98152024-11-27T18:42:31.731ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98162024-11-27T18:42:31.733ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98172024-11-27T18:42:31.734ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
98182024-11-27T18:42:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98192024-11-27T18:42:31.736ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98202024-11-27T18:42:31.739ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
98212024-11-27T18:42:31.739ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98222024-11-27T18:42:31.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98232024-11-27T18:42:31.746ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98242024-11-27T18:42:31.746ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
98252024-11-27T18:42:31.746ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 170.575418ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
98262024-11-27T18:42:31.761ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
98272024-11-27T18:42:31.761ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
98282024-11-27T18:42:31.761ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98292024-11-27T18:42:31.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98302024-11-27T18:42:31.763ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98312024-11-27T18:42:31.765ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-27T18:34:28.564237Z, time_modified: 2024-11-27T18:34:28.564237Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }) }
98322024-11-27T18:42:31.765ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 189.149393ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]}},"default_endpoint":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
98332024-11-27T18:42:31.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
98342024-11-27T18:42:31.767ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98352024-11-27T18:42:31.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98362024-11-27T18:42:31.770ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
98372024-11-27T18:42:31.770ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 0 version = 2
98382024-11-27T18:42:31.770ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98392024-11-27T18:42:31.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98402024-11-27T18:42:31.773ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98412024-11-27T18:42:31.773ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
98422024-11-27T18:42:31.773ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
98432024-11-27T18:42:31.773ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-27 18:34:43.283070 UTC dns_group = internal generation = 1
98442024-11-27T18:42:31.773ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 197.854012ms iteration = 10 status = {"generation":1}
98452024-11-27T18:42:31.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
98462024-11-27T18:42:31.775ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98472024-11-27T18:42:31.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98482024-11-27T18:42:31.778ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 1 version = 2
98492024-11-27T18:42:31.778ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
98502024-11-27T18:42:31.778ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-27 18:34:44.388958 UTC dns_group = external generation = 2
98512024-11-27T18:42:31.778ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 202.42241ms iteration = 10 status = {"generation":2}
98522024-11-27T18:42:31.780ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98532024-11-27T18:42:31.783ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
98542024-11-27T18:42:31.783ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98552024-11-27T18:42:31.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98562024-11-27T18:42:31.789ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
98572024-11-27T18:42:31.789ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 213.528654ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
98582024-11-27T18:42:31.805ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 229.157576ms iteration = 19 status = {"physical_disks_added":0}
98592024-11-27T18:42:31.825ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
98602024-11-27T18:42:31.825ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98612024-11-27T18:42:31.825ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3fe36716-379e-456a-bf58-0277c10a03b6", "content-length": "26", "date": "Wed, 27 Nov 2024 18:42:31 GMT"} })
98622024-11-27T18:42:31.825ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98632024-11-27T18:42:31.827ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
98642024-11-27T18:42:31.884ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
98652024-11-27T18:42:31.911ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
98662024-11-27T18:42:31.911ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c1ee542-898d-4a93-9bd0-8c8551de615d", "content-length": "1", "date": "Wed, 27 Nov 2024 18:42:31 GMT"} })
98672024-11-27T18:42:31.913ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
98682024-11-27T18:42:31.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
98692024-11-27T18:42:31.916ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 340.483676ms iteration = 17 status = null
98702024-11-27T18:42:31.948ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
98712024-11-27T18:42:31.948ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
98722024-11-27T18:42:31.949ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f1b2afc-a74c-49f1-8551-e9f2e819f308", "content-length": "372", "date": "Wed, 27 Nov 2024 18:42:31 GMT"} })
98732024-11-27T18:42:31.949ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98742024-11-27T18:42:31.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98752024-11-27T18:42:32.013ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
98762024-11-27T18:42:32.013ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
98772024-11-27T18:42:32.030ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
98782024-11-27T18:42:32.030ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
98792024-11-27T18:42:32.030ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "5c7c5ff5-a9b3-4827-b128-cacc5f1749f3", "date": "Wed, 27 Nov 2024 18:42:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
98802024-11-27T18:42:32.030ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
98812024-11-27T18:42:32.033ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "c49dbd59-53ce-49c8-b349-03829a75f86f", "date": "Wed, 27 Nov 2024 18:42:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
98822024-11-27T18:42:32.033ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
98832024-11-27T18:42:32.036ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
98842024-11-27T18:42:32.036ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 460.759258ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
98852024-11-27T18:42:32.044ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 468.613116ms iteration = 17 status = {}
98862024-11-27T18:42:32.050ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
98872024-11-27T18:42:32.051ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "7db4352f-9849-491e-94c8-312818f0eb05", "date": "Wed, 27 Nov 2024 18:42:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
98882024-11-27T18:42:32.051ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
98892024-11-27T18:42:32.053ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "cea15120-ed0d-4e88-8485-cf972930c091", "date": "Wed, 27 Nov 2024 18:42:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
98902024-11-27T18:42:32.053ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
98912024-11-27T18:42:32.055ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "1da8033b-d11a-4f90-be49-4d4241543ab6", "date": "Wed, 27 Nov 2024 18:42:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
98922024-11-27T18:42:32.055ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
98932024-11-27T18:42:32.057ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
98942024-11-27T18:42:32.057ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 481.349404ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
98952024-11-27T18:42:32.097ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "19fa2ca0-39e6-4cea-be36-56ccaef8aa46", "date": "Wed, 27 Nov 2024 18:42:31 GMT"} })
98962024-11-27T18:42:32.097ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98972024-11-27T18:42:32.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98982024-11-27T18:42:32.098ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e5ebf37-38c4-4683-9ad4-069a52d697ac", "content-length": "691", "date": "Wed, 27 Nov 2024 18:42:32 GMT"} })
98992024-11-27T18:42:32.098ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
99002024-11-27T18:42:32.098ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
99012024-11-27T18:42:32.098ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
99022024-11-27T18:42:32.099ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99032024-11-27T18:42:32.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99042024-11-27T18:42:32.100ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 524.761987ms iteration = 17 status = {}
99052024-11-27T18:42:32.103ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99062024-11-27T18:42:32.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99072024-11-27T18:42:32.108ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
99082024-11-27T18:42:32.108ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99092024-11-27T18:42:32.109ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "42d62cca-c3f5-4b25-a315-4a610a10b788", "date": "Wed, 27 Nov 2024 18:42:31 GMT"} })
99102024-11-27T18:42:32.111ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 535.501007ms iteration = 18 status = {}
99112024-11-27T18:42:32.128ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99122024-11-27T18:42:32.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99132024-11-27T18:42:32.130ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
99142024-11-27T18:42:32.130ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99152024-11-27T18:42:32.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99162024-11-27T18:42:32.140ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
99172024-11-27T18:42:32.140ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9376f7cc-9181-4f9b-a101-fb7d9d05c8d9", "content-length": "134", "date": "Wed, 27 Nov 2024 18:42:32 GMT"} })
99182024-11-27T18:42:32.140ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
99192024-11-27T18:42:32.140ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
99202024-11-27T18:42:32.140ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
99212024-11-27T18:42:32.140ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
99222024-11-27T18:42:32.140ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99232024-11-27T18:42:32.140ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99242024-11-27T18:42:32.140ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99252024-11-27T18:42:32.140ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99262024-11-27T18:42:32.140ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99272024-11-27T18:42:32.140ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99282024-11-27T18:42:32.141ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
99292024-11-27T18:42:32.141ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99302024-11-27T18:42:32.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99312024-11-27T18:42:32.143ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
99322024-11-27T18:42:32.143ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9eaed06-56fa-4910-9fb2-6c6884ff2297", "content-length": "2", "date": "Wed, 27 Nov 2024 18:42:32 GMT"} })
99332024-11-27T18:42:32.143ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
99342024-11-27T18:42:32.143ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a8bf492-dc54-4b63-97ee-e427a0296370", "content-length": "52", "date": "Wed, 27 Nov 2024 18:42:32 GMT"} })
99352024-11-27T18:42:32.143ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
99362024-11-27T18:42:32.143ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
99372024-11-27T18:42:32.231ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3963aa37-cf46-4661-b805-db9ac98c138a", "date": "Wed, 27 Nov 2024 18:42:31 GMT"} })
99382024-11-27T18:42:32.231ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
99392024-11-27T18:42:32.231ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
99402024-11-27T18:42:32.232ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "338d008e-ec78-4c14-8aa4-2a9c9b79f6dc", "content-length": "682", "date": "Wed, 27 Nov 2024 18:42:31 GMT"} })
99412024-11-27T18:42:32.232ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99422024-11-27T18:42:32.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99432024-11-27T18:42:32.236ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99442024-11-27T18:42:32.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99452024-11-27T18:42:32.239ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99462024-11-27T18:42:32.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99472024-11-27T18:42:32.241ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99482024-11-27T18:42:32.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99492024-11-27T18:42:32.249ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 673.016315ms iteration = 17 status = {}
99502024-11-27T18:42:38.742ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1024 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = e5313cd5-42a0-42e3-93ba-6c44ad216943 response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
99512024-11-27T18:42:41.575ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
99522024-11-27T18:42:41.576ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
99532024-11-27T18:42:41.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99542024-11-27T18:42:41.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99552024-11-27T18:42:41.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99562024-11-27T18:42:41.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99572024-11-27T18:42:41.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99582024-11-27T18:42:41.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99592024-11-27T18:42:41.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99602024-11-27T18:42:41.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
99612024-11-27T18:42:41.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99622024-11-27T18:42:41.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99632024-11-27T18:42:41.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99642024-11-27T18:42:41.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99652024-11-27T18:42:41.616ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99662024-11-27T18:42:41.618ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
99672024-11-27T18:42:41.618ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99682024-11-27T18:42:41.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99692024-11-27T18:42:41.630ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
99702024-11-27T18:42:41.630ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.638579ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
99712024-11-27T18:42:41.632ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.945254ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
99722024-11-27T18:42:48.744ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1577 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 3d2886ed-3325-4d22-b048-a8ded81dfd18 response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
99732024-11-27T18:42:51.576ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
99742024-11-27T18:42:51.576ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
99752024-11-27T18:42:51.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99762024-11-27T18:42:51.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99772024-11-27T18:42:51.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99782024-11-27T18:42:51.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99792024-11-27T18:42:51.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99802024-11-27T18:42:51.578ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99812024-11-27T18:42:51.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99822024-11-27T18:42:51.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
99832024-11-27T18:42:51.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99842024-11-27T18:42:51.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99852024-11-27T18:42:51.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99862024-11-27T18:42:51.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99872024-11-27T18:42:51.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99882024-11-27T18:42:51.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
99892024-11-27T18:42:51.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99902024-11-27T18:42:51.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99912024-11-27T18:42:51.598ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
99922024-11-27T18:42:51.598ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.551439ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
99932024-11-27T18:42:51.606ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.478332ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
99942024-11-27T18:42:58.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1295 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 34e112cb-dd59-49fe-9328-42feb3d0e98b response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
99952024-11-27T18:43:01.576ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
99962024-11-27T18:43:01.576ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
99972024-11-27T18:43:01.576ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
99982024-11-27T18:43:01.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
99992024-11-27T18:43:01.576ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
100002024-11-27T18:43:01.576ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
100012024-11-27T18:43:01.576ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
100022024-11-27T18:43:01.576ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
100032024-11-27T18:43:01.576ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
100042024-11-27T18:43:01.576ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
100052024-11-27T18:43:01.576ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
100062024-11-27T18:43:01.576ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
100072024-11-27T18:43:01.576ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
100082024-11-27T18:43:01.576ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
100092024-11-27T18:43:01.576ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
100102024-11-27T18:43:01.576ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
100112024-11-27T18:43:01.576ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
100122024-11-27T18:43:01.576ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
100132024-11-27T18:43:01.576ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
100142024-11-27T18:43:01.576ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
100152024-11-27T18:43:01.576ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
100162024-11-27T18:43:01.576ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
100172024-11-27T18:43:01.576ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100182024-11-27T18:43:01.576ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
100192024-11-27T18:43:01.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100202024-11-27T18:43:01.576ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
100212024-11-27T18:43:01.576ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
100222024-11-27T18:43:01.576ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
100232024-11-27T18:43:01.576ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
100242024-11-27T18:43:01.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100252024-11-27T18:43:01.576ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
100262024-11-27T18:43:01.576ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
100272024-11-27T18:43:01.576ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
100282024-11-27T18:43:01.576ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
100292024-11-27T18:43:01.576ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100302024-11-27T18:43:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
100312024-11-27T18:43:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
100322024-11-27T18:43:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
100332024-11-27T18:43:01.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
100342024-11-27T18:43:01.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
100352024-11-27T18:43:01.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100362024-11-27T18:43:01.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
100372024-11-27T18:43:01.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100382024-11-27T18:43:01.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100392024-11-27T18:43:01.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
100402024-11-27T18:43:01.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
100412024-11-27T18:43:01.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
100422024-11-27T18:43:01.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100432024-11-27T18:43:01.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
100442024-11-27T18:43:01.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
100452024-11-27T18:43:01.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
100462024-11-27T18:43:01.580ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.983148ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
100472024-11-27T18:43:01.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
100482024-11-27T18:43:01.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
100492024-11-27T18:43:01.585ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100502024-11-27T18:43:01.586ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2615, tv_nsec: 582294840 } })
100512024-11-27T18:43:01.586ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
100522024-11-27T18:43:01.587ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2615, tv_nsec: 584034686 } })
100532024-11-27T18:43:01.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
100542024-11-27T18:43:01.588ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
100552024-11-27T18:43:01.588ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
100562024-11-27T18:43:01.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
100572024-11-27T18:43:01.590ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100582024-11-27T18:43:01.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100592024-11-27T18:43:01.596ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100602024-11-27T18:43:01.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
100612024-11-27T18:43:01.599ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100622024-11-27T18:43:01.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100632024-11-27T18:43:01.603ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2615, tv_nsec: 599971412 } })
100642024-11-27T18:43:01.604ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
100652024-11-27T18:43:01.633ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100662024-11-27T18:43:01.635ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100672024-11-27T18:43:01.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
100682024-11-27T18:43:01.637ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
100692024-11-27T18:43:01.637ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
100702024-11-27T18:43:01.637ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
100712024-11-27T18:43:01.637ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
100722024-11-27T18:43:01.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
100732024-11-27T18:43:01.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
100742024-11-27T18:43:01.639ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100752024-11-27T18:43:01.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100762024-11-27T18:43:01.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100772024-11-27T18:43:01.640ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 63.964878ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
100782024-11-27T18:43:01.642ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
100792024-11-27T18:43:01.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
100802024-11-27T18:43:01.642ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 66.232061ms iteration = 18 status = {"errors":[],"records_set_to_done":[]}
100812024-11-27T18:43:01.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100822024-11-27T18:43:01.642ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
100832024-11-27T18:43:01.642ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
100842024-11-27T18:43:01.642ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
100852024-11-27T18:43:01.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100862024-11-27T18:43:01.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
100872024-11-27T18:43:01.644ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100882024-11-27T18:43:01.644ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100892024-11-27T18:43:01.644ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 68.350063ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
100902024-11-27T18:43:01.644ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100912024-11-27T18:43:01.645ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
100922024-11-27T18:43:01.645ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
100932024-11-27T18:43:01.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
100942024-11-27T18:43:01.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
100952024-11-27T18:43:01.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
100962024-11-27T18:43:01.648ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
100972024-11-27T18:43:01.648ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100982024-11-27T18:43:01.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
100992024-11-27T18:43:01.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
101002024-11-27T18:43:01.648ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101012024-11-27T18:43:01.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101022024-11-27T18:43:01.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
101032024-11-27T18:43:01.649ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101042024-11-27T18:43:01.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101052024-11-27T18:43:01.650ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 73.888516ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
101062024-11-27T18:43:01.650ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
101072024-11-27T18:43:01.650ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101082024-11-27T18:43:01.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101092024-11-27T18:43:01.651ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 74.957391ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
101102024-11-27T18:43:01.656ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101112024-11-27T18:43:01.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101122024-11-27T18:43:01.657ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
101132024-11-27T18:43:01.657ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 80.892869ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
101142024-11-27T18:43:01.666ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
101152024-11-27T18:43:01.666ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 90.049505ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
101162024-11-27T18:43:01.673ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
101172024-11-27T18:43:01.673ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
101182024-11-27T18:43:01.673ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed0eb91f-747d-498b-9e6b-127aea906885", "content-length": "26", "date": "Wed, 27 Nov 2024 18:43:01 GMT"} })
101192024-11-27T18:43:01.673ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
101202024-11-27T18:43:01.675ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
101212024-11-27T18:43:01.675ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
101222024-11-27T18:43:01.675ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
101232024-11-27T18:43:01.675ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c411256f-5506-40b8-a814-5297c79cabd6", "content-length": "26", "date": "Wed, 27 Nov 2024 18:43:01 GMT"} })
101242024-11-27T18:43:01.675ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
101252024-11-27T18:43:01.678ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
101262024-11-27T18:43:01.683ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101272024-11-27T18:43:01.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101282024-11-27T18:43:01.686ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101292024-11-27T18:43:01.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101302024-11-27T18:43:01.687ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
101312024-11-27T18:43:01.687ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
101322024-11-27T18:43:01.687ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 110.67967ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
101332024-11-27T18:43:01.687ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101342024-11-27T18:43:01.690ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
101352024-11-27T18:43:01.690ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101362024-11-27T18:43:01.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101372024-11-27T18:43:01.692ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 115.831217ms iteration = 18 status = 0
101382024-11-27T18:43:01.694ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101392024-11-27T18:43:01.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
101402024-11-27T18:43:01.701ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101412024-11-27T18:43:01.703ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
101422024-11-27T18:43:01.703ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101432024-11-27T18:43:01.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101442024-11-27T18:43:01.706ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
101452024-11-27T18:43:01.706ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
101462024-11-27T18:43:01.706ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0672cbd4-0a00-4e75-bd7b-6be4b7659039", "content-length": "26", "date": "Wed, 27 Nov 2024 18:43:01 GMT"} })
101472024-11-27T18:43:01.706ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
101482024-11-27T18:43:01.707ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
101492024-11-27T18:43:01.724ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 147.985733ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
101502024-11-27T18:43:01.733ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101512024-11-27T18:43:01.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101522024-11-27T18:43:01.761ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
101532024-11-27T18:43:01.761ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d26b3bc9-e913-4b92-af76-6f18a9790d70", "content-length": "1", "date": "Wed, 27 Nov 2024 18:43:01 GMT"} })
101542024-11-27T18:43:01.763ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
101552024-11-27T18:43:01.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
101562024-11-27T18:43:01.765ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 188.92811ms iteration = 18 status = null
101572024-11-27T18:43:01.769ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 193.426756ms iteration = 20 status = {"physical_disks_added":0}
101582024-11-27T18:43:01.776ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 200.481361ms iteration = 18 status = {}
101592024-11-27T18:43:01.845ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101602024-11-27T18:43:01.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101612024-11-27T18:43:01.847ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
101622024-11-27T18:43:01.847ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
101632024-11-27T18:43:01.847ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101642024-11-27T18:43:01.848ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "51506bd4-6200-4e1e-8ce1-102fe3c156d3", "content-length": "372", "date": "Wed, 27 Nov 2024 18:43:01 GMT"} })
101652024-11-27T18:43:01.848ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101662024-11-27T18:43:01.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101672024-11-27T18:43:01.849ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
101682024-11-27T18:43:01.849ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101692024-11-27T18:43:01.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101702024-11-27T18:43:01.878ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101712024-11-27T18:43:01.878ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101722024-11-27T18:43:01.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101732024-11-27T18:43:01.880ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
101742024-11-27T18:43:01.880ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101752024-11-27T18:43:01.880ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
101762024-11-27T18:43:01.880ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101772024-11-27T18:43:01.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101782024-11-27T18:43:01.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101792024-11-27T18:43:01.889ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
101802024-11-27T18:43:01.890ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b794c1d2-380d-4c5f-8e88-fc7432189e11", "content-length": "134", "date": "Wed, 27 Nov 2024 18:43:01 GMT"} })
101812024-11-27T18:43:01.890ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
101822024-11-27T18:43:01.890ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
101832024-11-27T18:43:01.890ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
101842024-11-27T18:43:01.890ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
101852024-11-27T18:43:01.890ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
101862024-11-27T18:43:01.890ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
101872024-11-27T18:43:01.890ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
101882024-11-27T18:43:01.890ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
101892024-11-27T18:43:01.890ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
101902024-11-27T18:43:01.890ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
101912024-11-27T18:43:01.890ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
101922024-11-27T18:43:01.890ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101932024-11-27T18:43:01.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101942024-11-27T18:43:01.893ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
101952024-11-27T18:43:01.893ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ec1a48b-345c-41ce-8a40-e65b17c0899d", "content-length": "2", "date": "Wed, 27 Nov 2024 18:43:01 GMT"} })
101962024-11-27T18:43:01.893ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
101972024-11-27T18:43:01.893ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f73d4f40-d9e6-49ca-a263-4b33304231ea", "content-length": "52", "date": "Wed, 27 Nov 2024 18:43:01 GMT"} })
101982024-11-27T18:43:01.893ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
101992024-11-27T18:43:01.893ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
102002024-11-27T18:43:01.893ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
102012024-11-27T18:43:01.893ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
102022024-11-27T18:43:01.914ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
102032024-11-27T18:43:01.990ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "dcefec47-4f20-4d90-8e5c-92a60d58557b", "date": "Wed, 27 Nov 2024 18:43:01 GMT"} })
102042024-11-27T18:43:01.990ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
102052024-11-27T18:43:01.990ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
102062024-11-27T18:43:01.990ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "57e1ca7b-5731-421b-95c5-17b2a7b194a3", "date": "Wed, 27 Nov 2024 18:43:01 GMT"} })
102072024-11-27T18:43:01.990ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102082024-11-27T18:43:01.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102092024-11-27T18:43:01.991ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb0fcc6e-28b7-446f-9135-78901d257944", "content-length": "682", "date": "Wed, 27 Nov 2024 18:43:01 GMT"} })
102102024-11-27T18:43:01.991ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102112024-11-27T18:43:01.991ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ad8ed9f-ff6d-4db7-8009-3ab8e404fa94", "content-length": "691", "date": "Wed, 27 Nov 2024 18:43:01 GMT"} })
102122024-11-27T18:43:01.991ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
102132024-11-27T18:43:01.991ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
102142024-11-27T18:43:01.991ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
102152024-11-27T18:43:01.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102162024-11-27T18:43:01.993ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 417.028361ms iteration = 18 status = {}
102172024-11-27T18:43:01.994ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102182024-11-27T18:43:01.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102192024-11-27T18:43:01.995ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102202024-11-27T18:43:01.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102212024-11-27T18:43:01.998ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102222024-11-27T18:43:01.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102232024-11-27T18:43:01.999ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102242024-11-27T18:43:02.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102252024-11-27T18:43:02.001ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
102262024-11-27T18:43:02.001ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
102272024-11-27T18:43:02.002ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102282024-11-27T18:43:02.002ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6c30ba92-32a7-432a-9ed7-ba94549cac39", "date": "Wed, 27 Nov 2024 18:43:01 GMT"} })
102292024-11-27T18:43:02.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102302024-11-27T18:43:02.004ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 427.74091ms iteration = 19 status = {}
102312024-11-27T18:43:02.010ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 434.223866ms iteration = 18 status = {}
102322024-11-27T18:43:08.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1169 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 79a2884f-f62f-495b-bd1c-95fbdb04ea29 response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
102332024-11-27T18:43:11.576ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
102342024-11-27T18:43:11.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102352024-11-27T18:43:11.576ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
102362024-11-27T18:43:11.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102372024-11-27T18:43:11.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102382024-11-27T18:43:11.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102392024-11-27T18:43:11.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102402024-11-27T18:43:11.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
102412024-11-27T18:43:11.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102422024-11-27T18:43:11.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102432024-11-27T18:43:11.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102442024-11-27T18:43:11.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102452024-11-27T18:43:11.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102462024-11-27T18:43:11.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
102472024-11-27T18:43:11.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102482024-11-27T18:43:11.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102492024-11-27T18:43:11.600ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
102502024-11-27T18:43:11.600ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.28494ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
102512024-11-27T18:43:11.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102522024-11-27T18:43:11.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102532024-11-27T18:43:11.631ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.704696ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
102542024-11-27T18:43:18.449ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:41332
102552024-11-27T18:43:18.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41332 req_id = ebaf1aaf-4c67-4be0-a276-56b318c69691 roles = RoleSet { roles: {} } uri = /metrics/producers
102562024-11-27T18:43:18.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41332 req_id = ebaf1aaf-4c67-4be0-a276-56b318c69691 resource = Database result = Ok(()) uri = /metrics/producers
102572024-11-27T18:43:18.483ZINFOnexus: assigned collector to new producer collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:76 producer_id = d7cc4ac1-6d92-4a20-8b63-97d7517b1cd5
102582024-11-27T18:43:18.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34786 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41332 req_id = ebaf1aaf-4c67-4be0-a276-56b318c69691 response_code = 201 uri = /metrics/producers
102592024-11-27T18:43:18.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1294 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = abdc412d-1f1d-40b7-8c8c-8ac234c52a5b response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
102602024-11-27T18:43:21.575ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
102612024-11-27T18:43:21.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102622024-11-27T18:43:21.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
102632024-11-27T18:43:21.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102642024-11-27T18:43:21.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102652024-11-27T18:43:21.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102662024-11-27T18:43:21.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102672024-11-27T18:43:21.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
102682024-11-27T18:43:21.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102692024-11-27T18:43:21.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102702024-11-27T18:43:21.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102712024-11-27T18:43:21.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102722024-11-27T18:43:21.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102732024-11-27T18:43:21.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
102742024-11-27T18:43:21.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102752024-11-27T18:43:21.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102762024-11-27T18:43:21.599ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
102772024-11-27T18:43:21.599ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.248555ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
102782024-11-27T18:43:21.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102792024-11-27T18:43:21.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102802024-11-27T18:43:21.634ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.101136ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
102812024-11-27T18:43:28.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 2a12702e-d3f2-4821-b532-37b861f8c5cc roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
102822024-11-27T18:43:28.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 2a12702e-d3f2-4821-b532-37b861f8c5cc resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
102832024-11-27T18:43:28.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3652 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 2a12702e-d3f2-4821-b532-37b861f8c5cc response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
102842024-11-27T18:43:28.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 9415eaa1-35df-434b-a9bd-3832877ff567 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
102852024-11-27T18:43:28.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 9415eaa1-35df-434b-a9bd-3832877ff567 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
102862024-11-27T18:43:28.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2752 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 9415eaa1-35df-434b-a9bd-3832877ff567 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
102872024-11-27T18:43:28.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 969 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = a87a49cf-8ee6-4e71-ab68-a49dd750d248 response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
102882024-11-27T18:43:31.576ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
102892024-11-27T18:43:31.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
102902024-11-27T18:43:31.576ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
102912024-11-27T18:43:31.576ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
102922024-11-27T18:43:31.576ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
102932024-11-27T18:43:31.576ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
102942024-11-27T18:43:31.576ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
102952024-11-27T18:43:31.576ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-27 18:33:31.576862346 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
102962024-11-27T18:43:31.576ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
102972024-11-27T18:43:31.576ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102982024-11-27T18:43:31.576ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
102992024-11-27T18:43:31.576ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
103002024-11-27T18:43:31.576ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
103012024-11-27T18:43:31.576ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
103022024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
103032024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103042024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
103052024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103062024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
103072024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
103082024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
103092024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
103102024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
103112024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
103122024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
103132024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
103142024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
103152024-11-27T18:43:31.577ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
103162024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103172024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
103182024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
103192024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
103202024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
103212024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
103222024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
103232024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
103242024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
103252024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103262024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
103272024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
103282024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
103292024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
103302024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
103312024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
103322024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
103332024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
103342024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
103352024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
103362024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
103372024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103382024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103392024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
103402024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
103412024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
103422024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
103432024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
103442024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
103452024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
103462024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
103472024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
103482024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
103492024-11-27T18:43:31.577ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 4ce244bc-1034-4855-877d-76a08bc15b71
103502024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
103512024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 8.451\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"4ce244bc-1034-4855-877d-76a08bc15b71"}
103522024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
103532024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
103542024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
103552024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
103562024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
103572024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103582024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
103592024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103602024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
103612024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
103622024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
103632024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103642024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
103652024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
103662024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103672024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
103682024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103692024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
103702024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
103712024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
103722024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
103732024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
103742024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
103752024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
103762024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103772024-11-27T18:43:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
103782024-11-27T18:43:31.577ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f378a24-7578-4d72-8454-f489a3e51ffb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e203eafc-5cbd-4249-8d8a-770878ed4d6d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 2645, tv_nsec: 574010327 } })
103792024-11-27T18:43:31.578ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("923a7051-0539-4413-bab4-c2b0d3395fe2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2645, tv_nsec: 574016167 } })
103802024-11-27T18:43:31.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
103812024-11-27T18:43:31.578ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
103822024-11-27T18:43:31.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
103832024-11-27T18:43:31.578ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
103842024-11-27T18:43:31.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
103852024-11-27T18:43:31.578ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
103862024-11-27T18:43:31.578ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
103872024-11-27T18:43:31.578ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.298039ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
103882024-11-27T18:43:31.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
103892024-11-27T18:43:31.578ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
103902024-11-27T18:43:31.578ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.237578ms iteration = 11 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
103912024-11-27T18:43:31.579ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
103922024-11-27T18:43:31.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
103932024-11-27T18:43:31.580ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-27 18:33:31.576862346 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
103942024-11-27T18:43:31.580ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.747286ms iteration = 10 status = {"expiration":"2024-11-27T18:33:31.576862346Z","pruned":[]}
103952024-11-27T18:43:31.581ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.076851ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
103962024-11-27T18:43:31.581ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2645, tv_nsec: 578065707 } })
103972024-11-27T18:43:31.582ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
103982024-11-27T18:43:31.583ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103992024-11-27T18:43:31.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
104002024-11-27T18:43:31.585ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104012024-11-27T18:43:31.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104022024-11-27T18:43:31.587ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104032024-11-27T18:43:31.588ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
104042024-11-27T18:43:31.588ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104052024-11-27T18:43:31.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104062024-11-27T18:43:31.591ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
104072024-11-27T18:43:31.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
104082024-11-27T18:43:31.591ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2645, tv_nsec: 587928313 } })
104092024-11-27T18:43:31.592ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
104102024-11-27T18:43:31.592ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
104112024-11-27T18:43:31.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
104122024-11-27T18:43:31.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
104132024-11-27T18:43:31.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
104142024-11-27T18:43:31.602ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 24.847838ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
104152024-11-27T18:43:31.605ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104162024-11-27T18:43:31.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
104172024-11-27T18:43:31.608ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
104182024-11-27T18:43:31.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
104192024-11-27T18:43:31.608ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104202024-11-27T18:43:31.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
104212024-11-27T18:43:31.611ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
104222024-11-27T18:43:31.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
104232024-11-27T18:43:31.613ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104242024-11-27T18:43:31.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
104252024-11-27T18:43:31.617ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
104262024-11-27T18:43:31.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
104272024-11-27T18:43:31.619ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104282024-11-27T18:43:31.621ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2645, tv_nsec: 617727605 } })
104292024-11-27T18:43:31.621ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
104302024-11-27T18:43:31.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
104312024-11-27T18:43:31.626ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104322024-11-27T18:43:31.626ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104332024-11-27T18:43:31.629ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
104342024-11-27T18:43:31.629ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104352024-11-27T18:43:31.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104362024-11-27T18:43:31.629ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104372024-11-27T18:43:31.632ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
104382024-11-27T18:43:31.632ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104392024-11-27T18:43:31.632ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
104402024-11-27T18:43:31.632ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
104412024-11-27T18:43:31.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
104422024-11-27T18:43:31.636ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
104432024-11-27T18:43:31.636ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
104442024-11-27T18:43:31.636ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
104452024-11-27T18:43:31.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
104462024-11-27T18:43:31.637ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104472024-11-27T18:43:31.637ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104482024-11-27T18:43:31.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104492024-11-27T18:43:31.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
104502024-11-27T18:43:31.639ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104512024-11-27T18:43:31.639ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104522024-11-27T18:43:31.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
104532024-11-27T18:43:31.640ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
104542024-11-27T18:43:31.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
104552024-11-27T18:43:31.641ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 63.910537ms iteration = 19 status = {"errors":[],"records_set_to_done":[]}
104562024-11-27T18:43:31.641ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
104572024-11-27T18:43:31.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
104582024-11-27T18:43:31.642ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
104592024-11-27T18:43:31.642ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
104602024-11-27T18:43:31.642ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
104612024-11-27T18:43:31.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
104622024-11-27T18:43:31.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
104632024-11-27T18:43:31.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
104642024-11-27T18:43:31.643ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
104652024-11-27T18:43:31.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
104662024-11-27T18:43:31.644ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
104672024-11-27T18:43:31.644ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
104682024-11-27T18:43:31.644ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 67.220956ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
104692024-11-27T18:43:31.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104702024-11-27T18:43:31.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104712024-11-27T18:43:31.645ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104722024-11-27T18:43:31.645ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
104732024-11-27T18:43:31.645ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
104742024-11-27T18:43:31.645ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
104752024-11-27T18:43:31.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
104762024-11-27T18:43:31.646ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 70.030379ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
104772024-11-27T18:43:31.647ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104782024-11-27T18:43:31.647ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
104792024-11-27T18:43:31.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
104802024-11-27T18:43:31.647ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 70.582956ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
104812024-11-27T18:43:31.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
104822024-11-27T18:43:31.649ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104832024-11-27T18:43:31.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
104842024-11-27T18:43:31.649ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
104852024-11-27T18:43:31.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
104862024-11-27T18:43:31.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
104872024-11-27T18:43:31.651ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104882024-11-27T18:43:31.652ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104892024-11-27T18:43:31.652ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104902024-11-27T18:43:31.653ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
104912024-11-27T18:43:31.654ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104922024-11-27T18:43:31.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
104932024-11-27T18:43:31.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
104942024-11-27T18:43:31.655ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
104952024-11-27T18:43:31.655ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104962024-11-27T18:43:31.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104972024-11-27T18:43:31.655ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
104982024-11-27T18:43:31.656ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
104992024-11-27T18:43:31.656ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
105002024-11-27T18:43:31.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
105012024-11-27T18:43:31.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
105022024-11-27T18:43:31.656ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105032024-11-27T18:43:31.657ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
105042024-11-27T18:43:31.657ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
105052024-11-27T18:43:31.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
105062024-11-27T18:43:31.658ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105072024-11-27T18:43:31.658ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
105082024-11-27T18:43:31.658ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
105092024-11-27T18:43:31.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105102024-11-27T18:43:31.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
105112024-11-27T18:43:31.662ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 85.329255ms iteration = 5 status = {"nsuccess":5}
105122024-11-27T18:43:31.666ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 89.467686ms iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
105132024-11-27T18:43:31.671ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
105142024-11-27T18:43:31.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
105152024-11-27T18:43:31.672ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
105162024-11-27T18:43:31.672ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 95.646288ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
105172024-11-27T18:43:31.677ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
105182024-11-27T18:43:31.677ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
105192024-11-27T18:43:31.677ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
105202024-11-27T18:43:31.677ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
105212024-11-27T18:43:31.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
105222024-11-27T18:43:31.679ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105232024-11-27T18:43:31.683ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
105242024-11-27T18:43:31.683ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
105252024-11-27T18:43:31.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
105262024-11-27T18:43:31.687ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105272024-11-27T18:43:31.687ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
105282024-11-27T18:43:31.687ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
105292024-11-27T18:43:31.687ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
105302024-11-27T18:43:31.687ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
105312024-11-27T18:43:31.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105322024-11-27T18:43:31.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
105332024-11-27T18:43:31.688ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
105342024-11-27T18:43:31.688ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
105352024-11-27T18:43:31.688ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 111.843878ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
105362024-11-27T18:43:31.689ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105372024-11-27T18:43:31.690ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105382024-11-27T18:43:31.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105392024-11-27T18:43:31.692ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105402024-11-27T18:43:31.693ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
105412024-11-27T18:43:31.693ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
105422024-11-27T18:43:31.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
105432024-11-27T18:43:31.694ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
105442024-11-27T18:43:31.694ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
105452024-11-27T18:43:31.694ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 117.576353ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
105462024-11-27T18:43:31.695ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
105472024-11-27T18:43:31.695ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105482024-11-27T18:43:31.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105492024-11-27T18:43:31.697ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 120.064799ms iteration = 19 status = 0
105502024-11-27T18:43:31.698ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 121.281118ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
105512024-11-27T18:43:31.699ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
105522024-11-27T18:43:31.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
105532024-11-27T18:43:31.701ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105542024-11-27T18:43:31.701ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 124.698609ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
105552024-11-27T18:43:31.702ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
105562024-11-27T18:43:31.702ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 125.674013ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
105572024-11-27T18:43:31.702ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
105582024-11-27T18:43:31.703ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
105592024-11-27T18:43:31.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
105602024-11-27T18:43:31.710ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
105612024-11-27T18:43:31.718ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
105622024-11-27T18:43:31.718ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
105632024-11-27T18:43:31.718ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5836fc61-11de-4b4d-b861-5916d8a3fdd1", "content-length": "26", "date": "Wed, 27 Nov 2024 18:43:31 GMT"} })
105642024-11-27T18:43:31.718ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
105652024-11-27T18:43:31.721ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
105662024-11-27T18:43:31.729ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
105672024-11-27T18:43:31.729ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
105682024-11-27T18:43:31.729ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
105692024-11-27T18:43:31.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
105702024-11-27T18:43:31.733ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
105712024-11-27T18:43:31.733ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 0 version = 2
105722024-11-27T18:43:31.733ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
105732024-11-27T18:43:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
105742024-11-27T18:43:31.736ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105752024-11-27T18:43:31.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
105762024-11-27T18:43:31.739ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
105772024-11-27T18:43:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
105782024-11-27T18:43:31.742ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 1 version = 2
105792024-11-27T18:43:31.742ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
105802024-11-27T18:43:31.742ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-27 18:34:44.388958 UTC dns_group = external generation = 2
105812024-11-27T18:43:31.742ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 164.850984ms iteration = 11 status = {"generation":2}
105822024-11-27T18:43:31.742ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-27T18:34:28.564237Z, time_modified: 2024-11-27T18:34:28.564237Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }) }
105832024-11-27T18:43:31.742ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 165.537334ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]}},"default_endpoint":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
105842024-11-27T18:43:31.766ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105852024-11-27T18:43:31.768ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 192.070427ms iteration = 21 status = {"physical_disks_added":0}
105862024-11-27T18:43:31.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
105872024-11-27T18:43:31.769ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
105882024-11-27T18:43:31.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
105892024-11-27T18:43:31.772ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105902024-11-27T18:43:31.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105912024-11-27T18:43:31.779ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
105922024-11-27T18:43:31.779ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
105932024-11-27T18:43:31.780ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7828867-4ff8-46a6-ab39-9c61d8663a67", "content-length": "26", "date": "Wed, 27 Nov 2024 18:43:31 GMT"} })
105942024-11-27T18:43:31.780ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
105952024-11-27T18:43:31.782ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
105962024-11-27T18:43:31.790ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
105972024-11-27T18:43:31.790ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 213.842889ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
105982024-11-27T18:43:31.837ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
105992024-11-27T18:43:31.897ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
106002024-11-27T18:43:31.897ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
106012024-11-27T18:43:31.897ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c32428a7-d233-4ad9-9049-564eb64fc26c", "content-length": "372", "date": "Wed, 27 Nov 2024 18:43:31 GMT"} })
106022024-11-27T18:43:31.897ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106032024-11-27T18:43:31.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106042024-11-27T18:43:31.899ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106052024-11-27T18:43:31.900ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
106062024-11-27T18:43:31.900ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
106072024-11-27T18:43:31.900ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-27 18:34:43.283070 UTC dns_group = internal generation = 1
106082024-11-27T18:43:31.900ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 323.302691ms iteration = 11 status = {"generation":1}
106092024-11-27T18:43:31.901ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
106102024-11-27T18:43:31.901ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106112024-11-27T18:43:31.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106122024-11-27T18:43:31.913ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
106132024-11-27T18:43:31.913ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
106142024-11-27T18:43:31.914ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "08bdfa9f-6260-483a-a541-6324473c9136", "content-length": "26", "date": "Wed, 27 Nov 2024 18:43:31 GMT"} })
106152024-11-27T18:43:31.914ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
106162024-11-27T18:43:31.916ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
106172024-11-27T18:43:31.930ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106182024-11-27T18:43:31.932ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
106192024-11-27T18:43:31.932ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106202024-11-27T18:43:31.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106212024-11-27T18:43:31.943ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
106222024-11-27T18:43:31.943ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
106232024-11-27T18:43:31.943ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3d53a00b-ca00-4616-984e-e3482b5f9132", "date": "Wed, 27 Nov 2024 18:43:31 GMT"} })
106242024-11-27T18:43:31.943ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106252024-11-27T18:43:31.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106262024-11-27T18:43:31.945ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106272024-11-27T18:43:31.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106282024-11-27T18:43:31.948ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106292024-11-27T18:43:31.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106302024-11-27T18:43:31.952ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
106312024-11-27T18:43:31.952ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
106322024-11-27T18:43:31.952ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "17409cea-56bb-4f2a-8cc3-bcb8c201989d", "date": "Wed, 27 Nov 2024 18:43:31 GMT"} })
106332024-11-27T18:43:31.954ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 377.406004ms iteration = 20 status = {}
106342024-11-27T18:43:32.024ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
106352024-11-27T18:43:32.024ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "34d15b94-3e78-4892-9624-0a94d7d611ec", "content-length": "1", "date": "Wed, 27 Nov 2024 18:43:31 GMT"} })
106362024-11-27T18:43:32.027ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
106372024-11-27T18:43:32.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
106382024-11-27T18:43:32.041ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
106392024-11-27T18:43:32.044ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
106402024-11-27T18:43:32.044ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "4b3992b3-eac6-4845-8e5e-eeb37831ab21", "date": "Wed, 27 Nov 2024 18:43:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
106412024-11-27T18:43:32.044ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
106422024-11-27T18:43:32.046ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "0ad27740-0d2c-45c4-8d5f-0ba48f2e65e0", "date": "Wed, 27 Nov 2024 18:43:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
106432024-11-27T18:43:32.046ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
106442024-11-27T18:43:32.048ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
106452024-11-27T18:43:32.048ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 471.63581ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
106462024-11-27T18:43:32.081ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 504.928823ms iteration = 19 status = {}
106472024-11-27T18:43:32.208ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
106482024-11-27T18:43:32.208ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "441f391f-3b8a-44aa-8d74-0d9b24a5e5c3", "content-length": "691", "date": "Wed, 27 Nov 2024 18:43:32 GMT"} })
106492024-11-27T18:43:32.208ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
106502024-11-27T18:43:32.208ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
106512024-11-27T18:43:32.208ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
106522024-11-27T18:43:32.209ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 632.950682ms iteration = 19 status = {}
106532024-11-27T18:43:32.210ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 633.427988ms iteration = 19 status = null
106542024-11-27T18:43:32.217ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106552024-11-27T18:43:32.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106562024-11-27T18:43:32.220ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
106572024-11-27T18:43:32.220ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106582024-11-27T18:43:32.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106592024-11-27T18:43:32.222ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
106602024-11-27T18:43:32.223ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "4156bc54-6248-4efa-b075-064e9af3ee6a", "date": "Wed, 27 Nov 2024 18:43:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
106612024-11-27T18:43:32.223ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
106622024-11-27T18:43:32.226ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b51ebe8f-d996-440e-9d0c-fa0cf0b65620", "date": "Wed, 27 Nov 2024 18:43:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
106632024-11-27T18:43:32.226ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
106642024-11-27T18:43:32.228ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "a253f1c4-acdf-4e48-98c4-218aa517551c", "date": "Wed, 27 Nov 2024 18:43:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
106652024-11-27T18:43:32.228ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
106662024-11-27T18:43:32.230ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
106672024-11-27T18:43:32.230ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 653.335414ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
106682024-11-27T18:43:32.231ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
106692024-11-27T18:43:32.231ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1b9c3db-46fc-4a88-8472-e085f7744e80", "content-length": "134", "date": "Wed, 27 Nov 2024 18:43:31 GMT"} })
106702024-11-27T18:43:32.231ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
106712024-11-27T18:43:32.231ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
106722024-11-27T18:43:32.232ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
106732024-11-27T18:43:32.232ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
106742024-11-27T18:43:32.232ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
106752024-11-27T18:43:32.232ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
106762024-11-27T18:43:32.232ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
106772024-11-27T18:43:32.232ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
106782024-11-27T18:43:32.232ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
106792024-11-27T18:43:32.232ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
106802024-11-27T18:43:32.232ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
106812024-11-27T18:43:32.232ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106822024-11-27T18:43:32.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106832024-11-27T18:43:32.235ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
106842024-11-27T18:43:32.235ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "758cbcee-14a0-4067-9b52-385d84d05513", "content-length": "2", "date": "Wed, 27 Nov 2024 18:43:31 GMT"} })
106852024-11-27T18:43:32.235ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
106862024-11-27T18:43:32.235ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9085aa9-e918-4c08-a5fe-40579cbfc81c", "content-length": "52", "date": "Wed, 27 Nov 2024 18:43:31 GMT"} })
106872024-11-27T18:43:32.235ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
106882024-11-27T18:43:32.235ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
106892024-11-27T18:43:32.348ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9206cfd0-75b3-40b9-8d56-1196175e6905", "date": "Wed, 27 Nov 2024 18:43:32 GMT"} })
106902024-11-27T18:43:32.348ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
106912024-11-27T18:43:32.348ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
106922024-11-27T18:43:32.349ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "52e88983-dece-4316-8625-5f000e8f7bd2", "content-length": "682", "date": "Wed, 27 Nov 2024 18:43:32 GMT"} })
106932024-11-27T18:43:32.349ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106942024-11-27T18:43:32.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106952024-11-27T18:43:32.358ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106962024-11-27T18:43:32.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106972024-11-27T18:43:32.362ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106982024-11-27T18:43:32.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106992024-11-27T18:43:32.364ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107002024-11-27T18:43:32.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107012024-11-27T18:43:32.372ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 795.364278ms iteration = 19 status = {}
107022024-11-27T18:43:38.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1687 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 3def9287-df12-431f-9f84-81660e9433d6 response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
107032024-11-27T18:43:41.576ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
107042024-11-27T18:43:41.576ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
107052024-11-27T18:43:41.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107062024-11-27T18:43:41.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107072024-11-27T18:43:41.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107082024-11-27T18:43:41.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107092024-11-27T18:43:41.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107102024-11-27T18:43:41.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
107112024-11-27T18:43:41.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107122024-11-27T18:43:41.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107132024-11-27T18:43:41.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107142024-11-27T18:43:41.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107152024-11-27T18:43:41.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107162024-11-27T18:43:41.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
107172024-11-27T18:43:41.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107182024-11-27T18:43:41.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107192024-11-27T18:43:41.602ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
107202024-11-27T18:43:41.602ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.602834ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
107212024-11-27T18:43:41.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107222024-11-27T18:43:41.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107232024-11-27T18:43:41.643ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 67.281357ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
107242024-11-27T18:43:48.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1216 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = ecd7d9e1-b751-4039-98f6-2e5ba0f822d7 response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
107252024-11-27T18:43:51.576ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
107262024-11-27T18:43:51.576ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
107272024-11-27T18:43:51.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107282024-11-27T18:43:51.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107292024-11-27T18:43:51.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107302024-11-27T18:43:51.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107312024-11-27T18:43:51.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107322024-11-27T18:43:51.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
107332024-11-27T18:43:51.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107342024-11-27T18:43:51.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107352024-11-27T18:43:51.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107362024-11-27T18:43:51.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107372024-11-27T18:43:51.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107382024-11-27T18:43:51.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107392024-11-27T18:43:51.606ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.294604ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
107402024-11-27T18:43:51.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107412024-11-27T18:43:51.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
107422024-11-27T18:43:51.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107432024-11-27T18:43:51.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107442024-11-27T18:43:51.627ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
107452024-11-27T18:43:51.627ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.491899ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
107462024-11-27T18:43:58.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 79a11314-5261-4459-964b-c01d2814e177 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
107472024-11-27T18:43:58.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 79a11314-5261-4459-964b-c01d2814e177 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
107482024-11-27T18:43:58.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3507 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 79a11314-5261-4459-964b-c01d2814e177 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
107492024-11-27T18:43:58.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = ac700837-bd2f-412e-a3c0-ac705da881a2 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
107502024-11-27T18:43:58.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = ac700837-bd2f-412e-a3c0-ac705da881a2 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
107512024-11-27T18:43:58.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2316 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = ac700837-bd2f-412e-a3c0-ac705da881a2 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
107522024-11-27T18:43:58.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 989 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 59450449-b528-4b2e-b43d-e7259e7f3393 response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
107532024-11-27T18:44:01.576ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
107542024-11-27T18:44:01.576ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
107552024-11-27T18:44:01.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107562024-11-27T18:44:01.576ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
107572024-11-27T18:44:01.576ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
107582024-11-27T18:44:01.576ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107592024-11-27T18:44:01.576ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
107602024-11-27T18:44:01.576ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
107612024-11-27T18:44:01.576ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
107622024-11-27T18:44:01.576ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
107632024-11-27T18:44:01.576ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
107642024-11-27T18:44:01.576ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
107652024-11-27T18:44:01.576ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
107662024-11-27T18:44:01.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107672024-11-27T18:44:01.576ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
107682024-11-27T18:44:01.576ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
107692024-11-27T18:44:01.576ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
107702024-11-27T18:44:01.576ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
107712024-11-27T18:44:01.576ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
107722024-11-27T18:44:01.576ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
107732024-11-27T18:44:01.576ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
107742024-11-27T18:44:01.576ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
107752024-11-27T18:44:01.576ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107762024-11-27T18:44:01.576ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
107772024-11-27T18:44:01.576ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
107782024-11-27T18:44:01.576ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
107792024-11-27T18:44:01.576ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
107802024-11-27T18:44:01.577ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
107812024-11-27T18:44:01.577ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
107822024-11-27T18:44:01.577ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
107832024-11-27T18:44:01.577ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107842024-11-27T18:44:01.577ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
107852024-11-27T18:44:01.577ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107862024-11-27T18:44:01.577ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
107872024-11-27T18:44:01.577ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
107882024-11-27T18:44:01.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
107892024-11-27T18:44:01.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107902024-11-27T18:44:01.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107912024-11-27T18:44:01.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
107922024-11-27T18:44:01.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
107932024-11-27T18:44:01.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107942024-11-27T18:44:01.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
107952024-11-27T18:44:01.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
107962024-11-27T18:44:01.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
107972024-11-27T18:44:01.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
107982024-11-27T18:44:01.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107992024-11-27T18:44:01.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
108002024-11-27T18:44:01.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108012024-11-27T18:44:01.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
108022024-11-27T18:44:01.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108032024-11-27T18:44:01.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
108042024-11-27T18:44:01.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108052024-11-27T18:44:01.581ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.319704ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
108062024-11-27T18:44:01.581ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2675, tv_nsec: 577935805 } })
108072024-11-27T18:44:01.582ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
108082024-11-27T18:44:01.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
108092024-11-27T18:44:01.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108102024-11-27T18:44:01.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108112024-11-27T18:44:01.584ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108122024-11-27T18:44:01.585ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108132024-11-27T18:44:01.586ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
108142024-11-27T18:44:01.586ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108152024-11-27T18:44:01.586ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2675, tv_nsec: 582374891 } })
108162024-11-27T18:44:01.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108172024-11-27T18:44:01.586ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
108182024-11-27T18:44:01.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
108192024-11-27T18:44:01.587ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
108202024-11-27T18:44:01.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
108212024-11-27T18:44:01.590ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108222024-11-27T18:44:01.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108232024-11-27T18:44:01.594ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108242024-11-27T18:44:01.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108252024-11-27T18:44:01.609ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108262024-11-27T18:44:01.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
108272024-11-27T18:44:01.611ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108282024-11-27T18:44:01.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108292024-11-27T18:44:01.615ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2675, tv_nsec: 611528463 } })
108302024-11-27T18:44:01.615ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
108312024-11-27T18:44:01.626ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108322024-11-27T18:44:01.628ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
108332024-11-27T18:44:01.628ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108342024-11-27T18:44:01.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108352024-11-27T18:44:01.629ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108362024-11-27T18:44:01.630ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 53.337141ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
108372024-11-27T18:44:01.632ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
108382024-11-27T18:44:01.632ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108392024-11-27T18:44:01.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108402024-11-27T18:44:01.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
108412024-11-27T18:44:01.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
108422024-11-27T18:44:01.635ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108432024-11-27T18:44:01.635ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
108442024-11-27T18:44:01.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108452024-11-27T18:44:01.635ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
108462024-11-27T18:44:01.635ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
108472024-11-27T18:44:01.635ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
108482024-11-27T18:44:01.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
108492024-11-27T18:44:01.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
108502024-11-27T18:44:01.637ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
108512024-11-27T18:44:01.637ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 60.950583ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
108522024-11-27T18:44:01.640ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.501701ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
108532024-11-27T18:44:01.643ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
108542024-11-27T18:44:01.643ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
108552024-11-27T18:44:01.643ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
108562024-11-27T18:44:01.643ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c8d99b4-c293-44ba-acbe-af6f0845268a", "content-length": "26", "date": "Wed, 27 Nov 2024 18:44:01 GMT"} })
108572024-11-27T18:44:01.643ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
108582024-11-27T18:44:01.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
108592024-11-27T18:44:01.645ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
108602024-11-27T18:44:01.645ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 68.935992ms iteration = 20 status = {"errors":[],"records_set_to_done":[]}
108612024-11-27T18:44:01.645ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 68.914001ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
108622024-11-27T18:44:01.645ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108632024-11-27T18:44:01.646ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
108642024-11-27T18:44:01.646ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
108652024-11-27T18:44:01.646ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c640c4af-df7b-49a3-aa27-12b2c6343efe", "content-length": "26", "date": "Wed, 27 Nov 2024 18:44:01 GMT"} })
108662024-11-27T18:44:01.646ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
108672024-11-27T18:44:01.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
108682024-11-27T18:44:01.647ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
108692024-11-27T18:44:01.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
108702024-11-27T18:44:01.648ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
108712024-11-27T18:44:01.649ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108722024-11-27T18:44:01.650ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
108732024-11-27T18:44:01.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
108742024-11-27T18:44:01.651ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108752024-11-27T18:44:01.651ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
108762024-11-27T18:44:01.651ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108772024-11-27T18:44:01.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108782024-11-27T18:44:01.653ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
108792024-11-27T18:44:01.653ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
108802024-11-27T18:44:01.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
108812024-11-27T18:44:01.658ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108822024-11-27T18:44:01.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108832024-11-27T18:44:01.660ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108842024-11-27T18:44:01.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108852024-11-27T18:44:01.662ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108862024-11-27T18:44:01.664ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
108872024-11-27T18:44:01.664ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108882024-11-27T18:44:01.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108892024-11-27T18:44:01.666ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
108902024-11-27T18:44:01.666ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 89.368695ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
108912024-11-27T18:44:01.666ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 89.956673ms iteration = 20 status = 0
108922024-11-27T18:44:01.670ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
108932024-11-27T18:44:01.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
108942024-11-27T18:44:01.670ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
108952024-11-27T18:44:01.670ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
108962024-11-27T18:44:01.671ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ae384f2-26cb-41db-833d-da0c513d23ad", "content-length": "26", "date": "Wed, 27 Nov 2024 18:44:01 GMT"} })
108972024-11-27T18:44:01.671ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
108982024-11-27T18:44:01.673ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
108992024-11-27T18:44:01.674ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
109002024-11-27T18:44:01.674ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
109012024-11-27T18:44:01.674ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
109022024-11-27T18:44:01.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
109032024-11-27T18:44:01.685ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 109.136978ms iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
109042024-11-27T18:44:01.704ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 127.400969ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
109052024-11-27T18:44:01.705ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109062024-11-27T18:44:01.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109072024-11-27T18:44:01.708ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
109082024-11-27T18:44:01.708ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
109092024-11-27T18:44:01.708ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 132.019947ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
109102024-11-27T18:44:01.716ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
109112024-11-27T18:44:01.716ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 140.063296ms iteration = 20 status = {}
109122024-11-27T18:44:01.717ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "372206a3-cffd-434e-a4f3-83f1afbda2a7", "content-length": "1", "date": "Wed, 27 Nov 2024 18:44:00 GMT"} })
109132024-11-27T18:44:01.718ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
109142024-11-27T18:44:01.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
109152024-11-27T18:44:01.720ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 143.632269ms iteration = 20 status = null
109162024-11-27T18:44:01.764ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 187.198274ms iteration = 22 status = {"physical_disks_added":0}
109172024-11-27T18:44:01.767ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109182024-11-27T18:44:01.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109192024-11-27T18:44:01.769ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109202024-11-27T18:44:01.770ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
109212024-11-27T18:44:01.770ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109222024-11-27T18:44:01.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109232024-11-27T18:44:01.772ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109242024-11-27T18:44:01.775ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
109252024-11-27T18:44:01.775ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109262024-11-27T18:44:01.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109272024-11-27T18:44:01.776ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
109282024-11-27T18:44:01.776ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
109292024-11-27T18:44:01.825ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109302024-11-27T18:44:01.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109312024-11-27T18:44:01.828ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
109322024-11-27T18:44:01.828ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109332024-11-27T18:44:01.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109342024-11-27T18:44:01.830ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4088c617-9ee5-4b20-80b5-a31e9a94d749", "content-length": "372", "date": "Wed, 27 Nov 2024 18:44:01 GMT"} })
109352024-11-27T18:44:01.830ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109362024-11-27T18:44:01.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109372024-11-27T18:44:01.840ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
109382024-11-27T18:44:01.840ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd123279-fe63-4e7f-a210-e17aec3936ad", "content-length": "134", "date": "Wed, 27 Nov 2024 18:44:01 GMT"} })
109392024-11-27T18:44:01.840ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
109402024-11-27T18:44:01.840ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
109412024-11-27T18:44:01.840ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
109422024-11-27T18:44:01.840ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
109432024-11-27T18:44:01.840ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109442024-11-27T18:44:01.840ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109452024-11-27T18:44:01.840ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109462024-11-27T18:44:01.840ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
109472024-11-27T18:44:01.841ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109482024-11-27T18:44:01.841ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
109492024-11-27T18:44:01.841ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
109502024-11-27T18:44:01.841ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109512024-11-27T18:44:01.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109522024-11-27T18:44:01.843ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
109532024-11-27T18:44:01.843ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "55162fef-56f3-48c1-ae73-3607193733dd", "content-length": "2", "date": "Wed, 27 Nov 2024 18:44:01 GMT"} })
109542024-11-27T18:44:01.843ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
109552024-11-27T18:44:01.843ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "91bb29b9-cd84-4ed3-a86f-a94e4ff60f02", "content-length": "52", "date": "Wed, 27 Nov 2024 18:44:01 GMT"} })
109562024-11-27T18:44:01.843ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
109572024-11-27T18:44:01.843ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
109582024-11-27T18:44:01.871ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
109592024-11-27T18:44:01.879ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
109602024-11-27T18:44:01.879ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
109612024-11-27T18:44:01.935ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "08640f5d-1ad0-417c-9d14-3da388c11961", "date": "Wed, 27 Nov 2024 18:44:01 GMT"} })
109622024-11-27T18:44:01.935ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
109632024-11-27T18:44:01.935ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
109642024-11-27T18:44:01.935ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "07b2251f-4385-4d1f-ad3e-0f6de7444789", "date": "Wed, 27 Nov 2024 18:44:01 GMT"} })
109652024-11-27T18:44:01.935ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109662024-11-27T18:44:01.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109672024-11-27T18:44:01.936ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ebf5c1d-59e1-4d3e-be67-e0daf41b919d", "content-length": "691", "date": "Wed, 27 Nov 2024 18:44:01 GMT"} })
109682024-11-27T18:44:01.936ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
109692024-11-27T18:44:01.936ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "538445b7-16eb-4958-8c6a-5b4f579a5f3f", "content-length": "682", "date": "Wed, 27 Nov 2024 18:44:01 GMT"} })
109702024-11-27T18:44:01.936ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
109712024-11-27T18:44:01.936ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
109722024-11-27T18:44:01.936ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109732024-11-27T18:44:01.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109742024-11-27T18:44:01.937ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 360.372912ms iteration = 20 status = {}
109752024-11-27T18:44:01.938ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109762024-11-27T18:44:01.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109772024-11-27T18:44:01.940ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109782024-11-27T18:44:01.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109792024-11-27T18:44:01.942ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109802024-11-27T18:44:01.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109812024-11-27T18:44:01.943ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109822024-11-27T18:44:01.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109832024-11-27T18:44:01.945ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109842024-11-27T18:44:01.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109852024-11-27T18:44:01.946ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
109862024-11-27T18:44:01.946ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
109872024-11-27T18:44:01.947ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c90e22d8-af83-410c-a608-b3197eba2bee", "date": "Wed, 27 Nov 2024 18:44:01 GMT"} })
109882024-11-27T18:44:01.948ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 371.78135ms iteration = 21 status = {}
109892024-11-27T18:44:01.952ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 376.080354ms iteration = 20 status = {}
109902024-11-27T18:44:08.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1371 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 2770762b-0327-439f-bb87-b623ac3ffed8 response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
109912024-11-27T18:44:11.576ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
109922024-11-27T18:44:11.576ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
109932024-11-27T18:44:11.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109942024-11-27T18:44:11.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109952024-11-27T18:44:11.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109962024-11-27T18:44:11.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109972024-11-27T18:44:11.579ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109982024-11-27T18:44:11.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109992024-11-27T18:44:11.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110002024-11-27T18:44:11.581ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.166662ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
110012024-11-27T18:44:11.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
110022024-11-27T18:44:11.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110032024-11-27T18:44:11.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110042024-11-27T18:44:11.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110052024-11-27T18:44:11.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110062024-11-27T18:44:11.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110072024-11-27T18:44:11.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
110082024-11-27T18:44:11.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110092024-11-27T18:44:11.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110102024-11-27T18:44:11.600ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
110112024-11-27T18:44:11.600ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.841723ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
110122024-11-27T18:44:18.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1000 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = de88e37c-7000-421d-a12c-0a0134a00256 response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
110132024-11-27T18:44:21.577ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
110142024-11-27T18:44:21.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110152024-11-27T18:44:21.577ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
110162024-11-27T18:44:21.577ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110172024-11-27T18:44:21.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110182024-11-27T18:44:21.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110192024-11-27T18:44:21.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110202024-11-27T18:44:21.579ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110212024-11-27T18:44:21.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110222024-11-27T18:44:21.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
110232024-11-27T18:44:21.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110242024-11-27T18:44:21.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110252024-11-27T18:44:21.581ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.538917ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
110262024-11-27T18:44:21.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110272024-11-27T18:44:21.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110282024-11-27T18:44:21.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110292024-11-27T18:44:21.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
110302024-11-27T18:44:21.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110312024-11-27T18:44:21.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110322024-11-27T18:44:21.598ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
110332024-11-27T18:44:21.598ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.57769ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
110342024-11-27T18:44:28.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 2741f846-bd5f-4bfa-a1ec-1503e12d0b49 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
110352024-11-27T18:44:28.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 2741f846-bd5f-4bfa-a1ec-1503e12d0b49 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
110362024-11-27T18:44:28.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2291 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 2741f846-bd5f-4bfa-a1ec-1503e12d0b49 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
110372024-11-27T18:44:28.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 7bb4b3e9-1658-40aa-a638-d7c997255e0e roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
110382024-11-27T18:44:28.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 7bb4b3e9-1658-40aa-a638-d7c997255e0e resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
110392024-11-27T18:44:28.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2634 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 7bb4b3e9-1658-40aa-a638-d7c997255e0e response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
110402024-11-27T18:44:28.744ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1663 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 1d35cb9f-5733-4dbd-b730-6bd3bddd9053 response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
110412024-11-27T18:44:31.576ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
110422024-11-27T18:44:31.576ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
110432024-11-27T18:44:31.576ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
110442024-11-27T18:44:31.576ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
110452024-11-27T18:44:31.576ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
110462024-11-27T18:44:31.576ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
110472024-11-27T18:44:31.576ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
110482024-11-27T18:44:31.576ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
110492024-11-27T18:44:31.576ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
110502024-11-27T18:44:31.576ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
110512024-11-27T18:44:31.576ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
110522024-11-27T18:44:31.576ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
110532024-11-27T18:44:31.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110542024-11-27T18:44:31.576ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
110552024-11-27T18:44:31.576ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
110562024-11-27T18:44:31.576ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
110572024-11-27T18:44:31.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
110582024-11-27T18:44:31.576ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
110592024-11-27T18:44:31.576ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
110602024-11-27T18:44:31.576ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
110612024-11-27T18:44:31.576ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
110622024-11-27T18:44:31.576ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110632024-11-27T18:44:31.576ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
110642024-11-27T18:44:31.576ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110652024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
110662024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
110672024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110682024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
110692024-11-27T18:44:31.577ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
110702024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110712024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
110722024-11-27T18:44:31.577ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 4ce244bc-1034-4855-877d-76a08bc15b71
110732024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
110742024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.251\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"4ce244bc-1034-4855-877d-76a08bc15b71"}
110752024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
110762024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
110772024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
110782024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
110792024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
110802024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
110812024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
110822024-11-27T18:44:31.577ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-27 18:34:31.577041613 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
110832024-11-27T18:44:31.577ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
110842024-11-27T18:44:31.577ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
110852024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
110862024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
110872024-11-27T18:44:31.577ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
110882024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
110892024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
110902024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
110912024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
110922024-11-27T18:44:31.577ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
110932024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110942024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
110952024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
110962024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
110972024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
110982024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
110992024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111002024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
111012024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
111022024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
111032024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
111042024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
111052024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
111062024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
111072024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
111082024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
111092024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
111102024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
111112024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
111122024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
111132024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
111142024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111152024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111162024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
111172024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111182024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
111192024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
111202024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
111212024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
111222024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
111232024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
111242024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
111252024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
111262024-11-27T18:44:31.577ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
111272024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111282024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111292024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111302024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
111312024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
111322024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111332024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
111342024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
111352024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
111362024-11-27T18:44:31.577ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("923a7051-0539-4413-bab4-c2b0d3395fe2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7585398-cabf-4150-8e11-981d1580aaf0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2705, tv_nsec: 573625261 } })
111372024-11-27T18:44:31.577ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f378a24-7578-4d72-8454-f489a3e51ffb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e203eafc-5cbd-4249-8d8a-770878ed4d6d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f12821e0-cc97-489a-9827-1dc6d06751bf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 2705, tv_nsec: 573634021 } })
111382024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
111392024-11-27T18:44:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
111402024-11-27T18:44:31.578ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
111412024-11-27T18:44:31.578ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.509693ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
111422024-11-27T18:44:31.578ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
111432024-11-27T18:44:31.578ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.494522ms iteration = 12 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
111442024-11-27T18:44:31.579ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
111452024-11-27T18:44:31.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
111462024-11-27T18:44:31.580ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.233958ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
111472024-11-27T18:44:31.580ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2705, tv_nsec: 576375942 } })
111482024-11-27T18:44:31.580ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
111492024-11-27T18:44:31.581ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111502024-11-27T18:44:31.582ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111512024-11-27T18:44:31.582ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2705, tv_nsec: 578690227 } })
111522024-11-27T18:44:31.583ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
111532024-11-27T18:44:31.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
111542024-11-27T18:44:31.583ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111552024-11-27T18:44:31.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111562024-11-27T18:44:31.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
111572024-11-27T18:44:31.585ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111582024-11-27T18:44:31.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111592024-11-27T18:44:31.586ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111602024-11-27T18:44:31.587ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
111612024-11-27T18:44:31.587ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
111622024-11-27T18:44:31.587ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 10.762349ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
111632024-11-27T18:44:31.587ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111642024-11-27T18:44:31.588ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
111652024-11-27T18:44:31.588ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
111662024-11-27T18:44:31.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
111672024-11-27T18:44:31.590ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
111682024-11-27T18:44:31.590ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
111692024-11-27T18:44:31.590ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111702024-11-27T18:44:31.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
111712024-11-27T18:44:31.592ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
111722024-11-27T18:44:31.592ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111732024-11-27T18:44:31.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
111742024-11-27T18:44:31.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111752024-11-27T18:44:31.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
111762024-11-27T18:44:31.594ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111772024-11-27T18:44:31.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111782024-11-27T18:44:31.595ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111792024-11-27T18:44:31.595ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
111802024-11-27T18:44:31.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
111812024-11-27T18:44:31.599ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-27 18:34:31.577041613 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
111822024-11-27T18:44:31.599ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 22.073247ms iteration = 11 status = {"expiration":"2024-11-27T18:34:31.577041613Z","pruned":[]}
111832024-11-27T18:44:31.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
111842024-11-27T18:44:31.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111852024-11-27T18:44:31.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111862024-11-27T18:44:31.604ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 27.469557ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
111872024-11-27T18:44:31.604ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
111882024-11-27T18:44:31.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
111892024-11-27T18:44:31.607ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2705, tv_nsec: 602939186 } })
111902024-11-27T18:44:31.607ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
111912024-11-27T18:44:31.608ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111922024-11-27T18:44:31.608ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
111932024-11-27T18:44:31.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
111942024-11-27T18:44:31.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111952024-11-27T18:44:31.608ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111962024-11-27T18:44:31.610ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111972024-11-27T18:44:31.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111982024-11-27T18:44:31.610ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111992024-11-27T18:44:31.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
112002024-11-27T18:44:31.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
112012024-11-27T18:44:31.613ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
112022024-11-27T18:44:31.613ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
112032024-11-27T18:44:31.613ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
112042024-11-27T18:44:31.613ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
112052024-11-27T18:44:31.613ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112062024-11-27T18:44:31.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
112072024-11-27T18:44:31.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112082024-11-27T18:44:31.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112092024-11-27T18:44:31.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
112102024-11-27T18:44:31.618ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112112024-11-27T18:44:31.618ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112122024-11-27T18:44:31.620ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112132024-11-27T18:44:31.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112142024-11-27T18:44:31.621ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(13f59999-9c86-4dfc-a124-b6c19f1b3024, 0), (64504a1c-7931-4bfd-b548-bce7e883eb71, 0), (2be03475-eba6-49d5-8d88-f99c929a0c6f, 0)]
112152024-11-27T18:44:31.621ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-b844cfb5-ff43-41f6-a61d-f7949f48466b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2705, tv_nsec: 617408350 } })
112162024-11-27T18:44:31.622ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
112172024-11-27T18:44:31.622ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
112182024-11-27T18:44:31.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
112192024-11-27T18:44:31.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
112202024-11-27T18:44:31.623ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
112212024-11-27T18:44:31.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
112222024-11-27T18:44:31.624ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 47.563015ms iteration = 21 status = {"errors":[],"records_set_to_done":[]}
112232024-11-27T18:44:31.625ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112242024-11-27T18:44:31.625ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112252024-11-27T18:44:31.626ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
112262024-11-27T18:44:31.626ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
112272024-11-27T18:44:31.626ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3
112282024-11-27T18:44:31.626ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2
112292024-11-27T18:44:31.626ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 7b69dd30-2708-4fd5-97b1-7624aa09c5a3
112302024-11-27T18:44:31.626ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = e610aa32-f1a2-472d-ac42-268cbf1b98b2
112312024-11-27T18:44:31.626ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = fe9ecd40-e26f-42da-8112-4fe24375259c
112322024-11-27T18:44:31.626ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112332024-11-27T18:44:31.627ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112342024-11-27T18:44:31.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112352024-11-27T18:44:31.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
112362024-11-27T18:44:31.629ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 52.550579ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":3,"recent_failures":[],"recent_recoveries":[]}
112372024-11-27T18:44:31.630ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
112382024-11-27T18:44:31.630ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
112392024-11-27T18:44:31.630ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
112402024-11-27T18:44:31.630ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112412024-11-27T18:44:31.630ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 53.426692ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
112422024-11-27T18:44:31.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
112432024-11-27T18:44:31.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112442024-11-27T18:44:31.631ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112452024-11-27T18:44:31.632ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
112462024-11-27T18:44:31.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
112472024-11-27T18:44:31.633ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112482024-11-27T18:44:31.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112492024-11-27T18:44:31.633ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.523578ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
112502024-11-27T18:44:31.633ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112512024-11-27T18:44:31.633ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
112522024-11-27T18:44:31.634ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
112532024-11-27T18:44:31.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
112542024-11-27T18:44:31.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
112552024-11-27T18:44:31.637ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
112562024-11-27T18:44:31.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
112572024-11-27T18:44:31.639ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112582024-11-27T18:44:31.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
112592024-11-27T18:44:31.644ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112602024-11-27T18:44:31.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112612024-11-27T18:44:31.646ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112622024-11-27T18:44:31.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112632024-11-27T18:44:31.648ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112642024-11-27T18:44:31.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112652024-11-27T18:44:31.649ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
112662024-11-27T18:44:31.649ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 72.480694ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
112672024-11-27T18:44:31.649ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112682024-11-27T18:44:31.649ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
112692024-11-27T18:44:31.649ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112702024-11-27T18:44:31.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
112712024-11-27T18:44:31.651ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
112722024-11-27T18:44:31.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
112732024-11-27T18:44:31.651ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
112742024-11-27T18:44:31.651ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 74.697507ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
112752024-11-27T18:44:31.652ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
112762024-11-27T18:44:31.652ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
112772024-11-27T18:44:31.652ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
112782024-11-27T18:44:31.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
112792024-11-27T18:44:31.653ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
112802024-11-27T18:44:31.653ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112812024-11-27T18:44:31.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112822024-11-27T18:44:31.654ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 77.860054ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
112832024-11-27T18:44:31.655ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
112842024-11-27T18:44:31.655ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112852024-11-27T18:44:31.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112862024-11-27T18:44:31.657ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
112872024-11-27T18:44:31.657ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112882024-11-27T18:44:31.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
112892024-11-27T18:44:31.659ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112902024-11-27T18:44:31.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112912024-11-27T18:44:31.659ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 82.759687ms iteration = 21 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
112922024-11-27T18:44:31.659ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
112932024-11-27T18:44:31.659ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112942024-11-27T18:44:31.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112952024-11-27T18:44:31.660ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
112962024-11-27T18:44:31.660ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
112972024-11-27T18:44:31.660ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
112982024-11-27T18:44:31.660ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
112992024-11-27T18:44:31.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
113002024-11-27T18:44:31.661ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113012024-11-27T18:44:31.664ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
113022024-11-27T18:44:31.664ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113032024-11-27T18:44:31.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113042024-11-27T18:44:31.664ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113052024-11-27T18:44:31.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113062024-11-27T18:44:31.666ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113072024-11-27T18:44:31.668ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 90.765476ms iteration = 21 status = 0
113082024-11-27T18:44:31.668ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113092024-11-27T18:44:31.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113102024-11-27T18:44:31.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
113112024-11-27T18:44:31.669ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
113122024-11-27T18:44:31.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
113132024-11-27T18:44:31.672ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113142024-11-27T18:44:31.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113152024-11-27T18:44:31.676ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113162024-11-27T18:44:31.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113172024-11-27T18:44:31.678ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
113182024-11-27T18:44:31.678ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 0 version = 2
113192024-11-27T18:44:31.678ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
113202024-11-27T18:44:31.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
113212024-11-27T18:44:31.679ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113222024-11-27T18:44:31.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113232024-11-27T18:44:31.682ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
113242024-11-27T18:44:31.682ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
113252024-11-27T18:44:31.682ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
113262024-11-27T18:44:31.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
113272024-11-27T18:44:31.682ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113282024-11-27T18:44:31.682ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
113292024-11-27T18:44:31.682ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113302024-11-27T18:44:31.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
113312024-11-27T18:44:31.683ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113322024-11-27T18:44:31.688ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
113332024-11-27T18:44:31.688ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
113342024-11-27T18:44:31.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
113352024-11-27T18:44:31.690ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
113362024-11-27T18:44:31.690ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113372024-11-27T18:44:31.691ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
113382024-11-27T18:44:31.691ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
113392024-11-27T18:44:31.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113402024-11-27T18:44:31.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
113412024-11-27T18:44:31.694ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 788880fc-8036-4798-b488-f4a8e0204e96 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
113422024-11-27T18:44:31.694ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
113432024-11-27T18:44:31.694ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-27 18:34:43.283070 UTC dns_group = internal generation = 1
113442024-11-27T18:44:31.694ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 117.274848ms iteration = 12 status = {"generation":1}
113452024-11-27T18:44:31.694ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2fbd3448-108e-485d-8a1b-f3ca10d86c82 dns_zone_name = oxide.test found_so_far = 1 version = 2
113462024-11-27T18:44:31.694ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
113472024-11-27T18:44:31.694ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-27 18:34:44.388958 UTC dns_group = external generation = 2
113482024-11-27T18:44:31.694ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 117.404981ms iteration = 12 status = {"generation":2}
113492024-11-27T18:44:31.695ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113502024-11-27T18:44:31.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113512024-11-27T18:44:31.696ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 119.660784ms iteration = 23 status = {"physical_disks_added":0}
113522024-11-27T18:44:31.697ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113532024-11-27T18:44:31.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113542024-11-27T18:44:31.697ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
113552024-11-27T18:44:31.697ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
113562024-11-27T18:44:31.697ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 120.738649ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
113572024-11-27T18:44:31.699ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
113582024-11-27T18:44:31.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
113592024-11-27T18:44:31.699ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113602024-11-27T18:44:31.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113612024-11-27T18:44:31.702ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 125.179405ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
113622024-11-27T18:44:31.703ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113632024-11-27T18:44:31.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113642024-11-27T18:44:31.703ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
113652024-11-27T18:44:31.703ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
113662024-11-27T18:44:31.703ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
113672024-11-27T18:44:31.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
113682024-11-27T18:44:31.704ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113692024-11-27T18:44:31.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113702024-11-27T18:44:31.706ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113712024-11-27T18:44:31.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113722024-11-27T18:44:31.707ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113732024-11-27T18:44:31.711ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
113742024-11-27T18:44:31.711ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113752024-11-27T18:44:31.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113762024-11-27T18:44:31.713ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113772024-11-27T18:44:31.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113782024-11-27T18:44:31.715ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113792024-11-27T18:44:31.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113802024-11-27T18:44:31.721ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113812024-11-27T18:44:31.724ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
113822024-11-27T18:44:31.724ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
113832024-11-27T18:44:31.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
113842024-11-27T18:44:31.735ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
113852024-11-27T18:44:31.735ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
113862024-11-27T18:44:31.735ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 158.628961ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
113872024-11-27T18:44:31.753ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113882024-11-27T18:44:31.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113892024-11-27T18:44:31.775ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-27T18:34:28.564237Z, time_modified: 2024-11-27T18:34:28.564237Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, db_silo: Silo { identity: SiloIdentity { id: 40016410-ac98-42a3-b0ca-e7ce46b4e8ba, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-27T18:34:44.336541Z, time_modified: 2024-11-27T18:34:44.336541Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9" }] }) }
113902024-11-27T18:44:31.775ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 198.352979ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]}},"default_endpoint":{"silo_id":"40016410-ac98-42a3-b0ca-e7ce46b4e8ba","tls_certs":["6d21ec4bc5816fa047df2cd45b72da7863595d50afde0f12c586d134c97161c9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
113912024-11-27T18:44:31.775ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 zone_address = fd00:1122:3344:101::2
113922024-11-27T18:44:31.775ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
113932024-11-27T18:44:31.776ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7139ae5e-5420-45bf-a9f6-dc8b50e186f9", "content-length": "26", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
113942024-11-27T18:44:31.776ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
113952024-11-27T18:44:31.777ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
113962024-11-27T18:44:31.804ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
113972024-11-27T18:44:31.804ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
113982024-11-27T18:44:31.805ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "67a3d6ec-6351-4af7-9041-d4cb886ee8a2", "content-length": "26", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
113992024-11-27T18:44:31.805ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
114002024-11-27T18:44:31.807ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
114012024-11-27T18:44:31.813ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
114022024-11-27T18:44:31.813ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 236.779229ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
114032024-11-27T18:44:31.821ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114042024-11-27T18:44:31.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114052024-11-27T18:44:31.861ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
114062024-11-27T18:44:31.945ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
114072024-11-27T18:44:31.949ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
114082024-11-27T18:44:31.949ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
114092024-11-27T18:44:31.949ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0bef54f3-ca62-4c5f-ab33-82b7b0d71e1d", "content-length": "26", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
114102024-11-27T18:44:31.949ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
114112024-11-27T18:44:31.951ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
114122024-11-27T18:44:31.970ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
114132024-11-27T18:44:31.970ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
114142024-11-27T18:44:31.972ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114152024-11-27T18:44:31.972ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114162024-11-27T18:44:31.974ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
114172024-11-27T18:44:31.974ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114182024-11-27T18:44:31.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114192024-11-27T18:44:31.976ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114202024-11-27T18:44:31.976ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
114212024-11-27T18:44:31.976ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114222024-11-27T18:44:31.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114232024-11-27T18:44:31.979ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
114242024-11-27T18:44:31.979ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114252024-11-27T18:44:31.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114262024-11-27T18:44:31.982ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114272024-11-27T18:44:31.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114282024-11-27T18:44:31.984ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114292024-11-27T18:44:31.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114302024-11-27T18:44:31.987ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114312024-11-27T18:44:31.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114322024-11-27T18:44:31.989ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114332024-11-27T18:44:31.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114342024-11-27T18:44:31.997ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
114352024-11-27T18:44:31.997ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
114362024-11-27T18:44:31.997ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
114372024-11-27T18:44:31.998ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b047283-2d36-4600-92f2-9334b50ae0c6", "content-length": "476", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
114382024-11-27T18:44:31.998ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
114392024-11-27T18:44:31.998ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3057a8bb-3525-4ccb-ac0c-85a67fc23e95", "content-length": "734", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
114402024-11-27T18:44:31.998ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
114412024-11-27T18:44:31.999ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6dc3700-05f9-4e9c-9abb-b6b403d6b336", "content-length": "111", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
114422024-11-27T18:44:31.999ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
114432024-11-27T18:44:31.999ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "54dfdd95-0893-4751-bd4d-ca6cd626cb5a", "content-length": "111", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
114442024-11-27T18:44:31.999ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
114452024-11-27T18:44:31.999ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea7c064a-fa70-4d96-8cb1-e5efe5b83658", "content-length": "167", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
114462024-11-27T18:44:31.999ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
114472024-11-27T18:44:32.000ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "982dd9b4-be9f-4213-980a-54d68fdee0c5", "content-length": "167", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
114482024-11-27T18:44:32.000ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
114492024-11-27T18:44:32.000ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8760bc73-5731-442c-aebd-4cb56f85fde0", "content-length": "175", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
114502024-11-27T18:44:32.000ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
114512024-11-27T18:44:32.000ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7917f5c-be5c-41ca-9ee6-0c4d9667952c", "content-length": "175", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
114522024-11-27T18:44:32.000ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
114532024-11-27T18:44:32.000ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ea19413-a732-4ccc-bf9d-c5d923f6582c", "content-length": "702", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
114542024-11-27T18:44:32.000ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
114552024-11-27T18:44:32.001ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b19f6b0a-014c-4d7a-85d9-347fd32ec2e1", "content-length": "727", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
114562024-11-27T18:44:32.001ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
114572024-11-27T18:44:32.001ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff9e0dea-36e1-4d7c-b001-905e37265118", "content-length": "729", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
114582024-11-27T18:44:32.001ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
114592024-11-27T18:44:32.001ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca406747-72d5-4ad2-a819-90c64b86f76e", "content-length": "728", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
114602024-11-27T18:44:32.001ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
114612024-11-27T18:44:32.001ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad4ff430-bd19-43da-82a8-1ad72c02237d", "content-length": "722", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
114622024-11-27T18:44:32.001ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
114632024-11-27T18:44:32.002ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d867a10d-2f47-43c0-9cbf-564fc8e84a47", "content-length": "109", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
114642024-11-27T18:44:32.002ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
114652024-11-27T18:44:32.002ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d8a79d7-bbc8-4a36-83ff-62d837cc1831", "content-length": "109", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
114662024-11-27T18:44:32.002ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
114672024-11-27T18:44:32.002ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7854c18d-a59a-425a-a43e-c5515013de67", "content-length": "169", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
114682024-11-27T18:44:32.002ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
114692024-11-27T18:44:32.003ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "03d01d7a-be07-4e2c-9524-eaee8751458b", "content-length": "169", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
114702024-11-27T18:44:32.003ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
114712024-11-27T18:44:32.003ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c51cea3c-f65a-4f7a-9b39-3096eae86040", "content-length": "178", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
114722024-11-27T18:44:32.003ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
114732024-11-27T18:44:32.003ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9eeb6575-4ce2-4baf-9889-9bbc5c6a758e", "content-length": "178", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
114742024-11-27T18:44:32.003ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
114752024-11-27T18:44:32.004ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "34987ce4-73d2-4ea7-a172-668b13926c09", "content-length": "702", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
114762024-11-27T18:44:32.004ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
114772024-11-27T18:44:32.004ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "273b4cf7-d5aa-4d62-b763-99fb807caa5c", "content-length": "727", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
114782024-11-27T18:44:32.004ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
114792024-11-27T18:44:32.004ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c57e68d-08c4-4cd5-94f0-dab2df523276", "content-length": "729", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
114802024-11-27T18:44:32.004ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
114812024-11-27T18:44:32.008ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f34e18be-a387-491e-94c2-12e4ef16ef67", "content-length": "728", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
114822024-11-27T18:44:32.010ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
114832024-11-27T18:44:32.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
114842024-11-27T18:44:32.085ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
114852024-11-27T18:44:32.085ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "63846fa1-7e68-4268-b065-5898ac9b2418", "content-length": "1", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
114862024-11-27T18:44:32.087ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
114872024-11-27T18:44:32.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
114882024-11-27T18:44:32.094ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc7868dc-a7ad-43de-acde-061c19c7614f", "content-length": "372", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
114892024-11-27T18:44:32.094ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114902024-11-27T18:44:32.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114912024-11-27T18:44:32.125ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
114922024-11-27T18:44:32.153ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
114932024-11-27T18:44:32.154ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf83262b-b7a6-4be9-a0f9-3a475e052f75", "content-length": "691", "date": "Wed, 27 Nov 2024 18:44:32 GMT"} })
114942024-11-27T18:44:32.154ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
114952024-11-27T18:44:32.154ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
114962024-11-27T18:44:32.154ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
114972024-11-27T18:44:32.155ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114982024-11-27T18:44:32.155ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 579.023112ms iteration = 21 status = {}
114992024-11-27T18:44:32.155ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115002024-11-27T18:44:32.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115012024-11-27T18:44:32.157ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 580.649355ms iteration = 21 status = null
115022024-11-27T18:44:32.157ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
115032024-11-27T18:44:32.157ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
115042024-11-27T18:44:32.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
115052024-11-27T18:44:32.158ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115062024-11-27T18:44:32.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115072024-11-27T18:44:32.159ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115082024-11-27T18:44:32.159ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115092024-11-27T18:44:32.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115102024-11-27T18:44:32.161ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
115112024-11-27T18:44:32.161ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
115122024-11-27T18:44:32.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
115132024-11-27T18:44:32.161ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115142024-11-27T18:44:32.167ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
115152024-11-27T18:44:32.167ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115162024-11-27T18:44:32.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115172024-11-27T18:44:32.169ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115182024-11-27T18:44:32.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115192024-11-27T18:44:32.170ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115202024-11-27T18:44:32.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115212024-11-27T18:44:32.171ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115222024-11-27T18:44:32.175ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
115232024-11-27T18:44:32.175ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115242024-11-27T18:44:32.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115252024-11-27T18:44:32.181ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 604.50734ms iteration = 21 status = {}
115262024-11-27T18:44:32.182ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 2df4b43c-19b2-4d0e-9115-0713223786a3, kind: Service { id: fbc95b29-f83d-43ed-91f4-c64d49d2794a }, name: Name("nexus-fbc95b29-f83d-43ed-91f4-c64d49d2794a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 135])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 36b26f77-d20c-42ae-beb2-a2ba0a652ee7, kind: Service { id: 236c7b74-8315-46e3-9a37-90380a675558 }, name: Name("nexus-236c7b74-8315-46e3-9a37-90380a675558"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 105])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d3055ccd-84f0-4f36-b8e4-3dbd5b104332, kind: Service { id: 028a6b4a-281e-48cb-ac6a-4e4dfed5a146 }, name: Name("nexus-028a6b4a-281e-48cb-ac6a-4e4dfed5a146"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 46807e0d-b32c-46e9-ba6d-70ce0dd8f478, kind: Service { id: 923a7051-0539-4413-bab4-c2b0d3395fe2 }, name: Name("external-dns-923a7051-0539-4413-bab4-c2b0d3395fe2"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 247])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ae80547a-3043-414a-9677-e92884742152, kind: Service { id: b7585398-cabf-4150-8e11-981d1580aaf0 }, name: Name("external-dns-b7585398-cabf-4150-8e11-981d1580aaf0"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 255])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
115272024-11-27T18:44:32.182ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115282024-11-27T18:44:32.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115292024-11-27T18:44:32.184ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115302024-11-27T18:44:32.186ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
115312024-11-27T18:44:32.186ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115322024-11-27T18:44:32.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115332024-11-27T18:44:32.188ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
115342024-11-27T18:44:32.188ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 46807e0d-b32c-46e9-ba6d-70ce0dd8f478, kind: Service { id: 923a7051-0539-4413-bab4-c2b0d3395fe2 }, name: Name("external-dns-923a7051-0539-4413-bab4-c2b0d3395fe2"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 247])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ae80547a-3043-414a-9677-e92884742152, kind: Service { id: b7585398-cabf-4150-8e11-981d1580aaf0 }, name: Name("external-dns-b7585398-cabf-4150-8e11-981d1580aaf0"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 255])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 2df4b43c-19b2-4d0e-9115-0713223786a3, kind: Service { id: fbc95b29-f83d-43ed-91f4-c64d49d2794a }, name: Name("nexus-fbc95b29-f83d-43ed-91f4-c64d49d2794a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 135])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 36b26f77-d20c-42ae-beb2-a2ba0a652ee7, kind: Service { id: 236c7b74-8315-46e3-9a37-90380a675558 }, name: Name("nexus-236c7b74-8315-46e3-9a37-90380a675558"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 105])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d3055ccd-84f0-4f36-b8e4-3dbd5b104332, kind: Service { id: 028a6b4a-281e-48cb-ac6a-4e4dfed5a146 }, name: Name("nexus-028a6b4a-281e-48cb-ac6a-4e4dfed5a146"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
115352024-11-27T18:44:32.188ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
115362024-11-27T18:44:32.198ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
115372024-11-27T18:44:32.198ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
115382024-11-27T18:44:32.199ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fdb90ece-efdb-453e-adbb-9f1459bb1c6c", "date": "Wed, 27 Nov 2024 18:44:32 GMT"} })
115392024-11-27T18:44:32.199ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115402024-11-27T18:44:32.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115412024-11-27T18:44:32.201ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115422024-11-27T18:44:32.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115432024-11-27T18:44:32.204ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115442024-11-27T18:44:32.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115452024-11-27T18:44:32.208ZINFOnexus (BackgroundTasks): VPC route manager sled b844cfb5-ff43-41f6-a61d-f7949f48466b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
115462024-11-27T18:44:32.208ZDEBGnexus (BackgroundTasks): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
115472024-11-27T18:44:32.212ZDEBGnexus (BackgroundTasks): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "017f04d1-7e7e-4dd9-a3eb-8598fe83ee87", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
115482024-11-27T18:44:32.215ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 638.92479ms iteration = 22 status = {}
115492024-11-27T18:44:32.231ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
115502024-11-27T18:44:32.232ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "69b7005a-e1fe-4374-860a-2c8463474ebd", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
115512024-11-27T18:44:32.232ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
115522024-11-27T18:44:32.238ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ef900082-0d2e-4f3b-858c-a684af03f590", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
115532024-11-27T18:44:32.238ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
115542024-11-27T18:44:32.245ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
115552024-11-27T18:44:32.245ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 668.258115ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
115562024-11-27T18:44:32.251ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
115572024-11-27T18:44:32.251ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "8285f0d3-fc95-41d4-b436-583adac1525a", "date": "Wed, 27 Nov 2024 18:44:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
115582024-11-27T18:44:32.251ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
115592024-11-27T18:44:32.255ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "dbd5c2c5-0316-49b3-a1e0-6efb75c906a8", "date": "Wed, 27 Nov 2024 18:44:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
115602024-11-27T18:44:32.255ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
115612024-11-27T18:44:32.260ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "40875ddc-20d6-464c-b1e7-ddf1ce365a5e", "date": "Wed, 27 Nov 2024 18:44:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
115622024-11-27T18:44:32.260ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
115632024-11-27T18:44:32.263ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
115642024-11-27T18:44:32.263ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 686.338543ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
115652024-11-27T18:44:32.265ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: b844cfb5-ff43-41f6-a61d-f7949f48466b, time_created: 2024-11-27T18:34:40.308972Z, time_modified: 2024-11-27T18:34:40.308972Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
115662024-11-27T18:44:32.265ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
115672024-11-27T18:44:32.265ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115682024-11-27T18:44:32.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115692024-11-27T18:44:32.325ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
115702024-11-27T18:44:32.325ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
115712024-11-27T18:44:32.327ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115722024-11-27T18:44:32.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115732024-11-27T18:44:32.330ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115742024-11-27T18:44:32.333ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: b844cfb5-ff43-41f6-a61d-f7949f48466b, lookup_type: ById(b844cfb5-ff43-41f6-a61d-f7949f48466b) } result = Ok(())
115752024-11-27T18:44:32.340ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115762024-11-27T18:44:32.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115772024-11-27T18:44:32.342ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5c1a7720-b91d-4487-9768-ed70c167c78b, rack_id: 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(372644c7-ce22-4073-b8f0-a1509588ee6f) } rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
115782024-11-27T18:44:32.342ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115792024-11-27T18:44:32.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115802024-11-27T18:44:32.353ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
115812024-11-27T18:44:32.353ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a1ea405-424d-4cef-9366-c8c856ecd04f", "content-length": "134", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
115822024-11-27T18:44:32.353ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
115832024-11-27T18:44:32.353ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 372644c7-ce22-4073-b8f0-a1509588ee6f
115842024-11-27T18:44:32.353ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
115852024-11-27T18:44:32.353ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
115862024-11-27T18:44:32.353ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115872024-11-27T18:44:32.353ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115882024-11-27T18:44:32.353ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115892024-11-27T18:44:32.353ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
115902024-11-27T18:44:32.353ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115912024-11-27T18:44:32.353ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
115922024-11-27T18:44:32.354ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2
115932024-11-27T18:44:32.354ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115942024-11-27T18:44:32.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115952024-11-27T18:44:32.356ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
115962024-11-27T18:44:32.356ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "083ef6cf-2531-457f-8141-8ed28d7a0ee7", "content-length": "2", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
115972024-11-27T18:44:32.356ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
115982024-11-27T18:44:32.356ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b7b4e48-a113-40f5-9791-5e7ca4dd96de", "content-length": "52", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
115992024-11-27T18:44:32.356ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch_location = Switch0
116002024-11-27T18:44:32.356ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
116012024-11-27T18:44:32.374ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
116022024-11-27T18:44:32.382ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = b844cfb5-ff43-41f6-a61d-f7949f48466b background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "3ab443ff-b58a-4cc0-9038-4a80421b5b31", "date": "Wed, 27 Nov 2024 18:44:32 GMT"} })
116032024-11-27T18:44:32.383ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
116042024-11-27T18:44:32.383ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 806.381262ms
116052024-11-27T18:44:32.383ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 806.390383ms iteration = 3 status = {}
116062024-11-27T18:44:32.465ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "193ff306-68a2-4c4d-b4a4-42d9ed1b6556", "date": "Wed, 27 Nov 2024 18:44:31 GMT"} })
116072024-11-27T18:44:32.465ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 switch = Switch0
116082024-11-27T18:44:32.465ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
116092024-11-27T18:44:32.465ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 62a8af4d-fc95-42f9-a9e4-071aa14ffdb2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ed994d8-2e58-486a-9b4c-5e923a6b909a", "content-length": "682", "date": "Wed, 27 Nov 2024 18:44:32 GMT"} })
116102024-11-27T18:44:32.466ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116112024-11-27T18:44:32.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116122024-11-27T18:44:32.470ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116132024-11-27T18:44:32.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116142024-11-27T18:44:32.474ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116152024-11-27T18:44:32.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116162024-11-27T18:44:32.476ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116172024-11-27T18:44:32.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116182024-11-27T18:44:32.485ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 908.484506ms iteration = 21 status = {}
116192024-11-27T18:44:32.631ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "5140fdf6-c025-496b-a8c5-478891ad7b69", "content-length": "30797", "date": "Wed, 27 Nov 2024 18:44:32 GMT"} })
116202024-11-27T18:44:32.633ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
116212024-11-27T18:44:32.633ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
116222024-11-27T18:44:32.633ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
116232024-11-27T18:44:32.639ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
116242024-11-27T18:44:32.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
116252024-11-27T18:44:32.641ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116262024-11-27T18:44:32.643ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
116272024-11-27T18:44:32.644ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
116282024-11-27T18:44:32.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
116292024-11-27T18:44:32.830ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = cbde92c1-68df-4fc9-ba03-f98be25d685b file = nexus/db-queries/src/db/datastore/inventory.rs:1006
116302024-11-27T18:44:32.830ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = cbde92c1-68df-4fc9-ba03-f98be25d685b time_started = 2024-11-27 18:44:31.997854 UTC
116312024-11-27T18:44:32.830ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.253975286s iteration = 3 status = {"collection_id":"cbde92c1-68df-4fc9-ba03-f98be25d685b","time_done":"2024-11-27 18:44:32.633272 UTC","time_started":"2024-11-27 18:44:31.997854 UTC"}
116322024-11-27T18:44:32.831ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
116332024-11-27T18:44:32.831ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
116342024-11-27T18:44:32.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
116352024-11-27T18:44:32.833ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116362024-11-27T18:44:32.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
116372024-11-27T18:44:32.835ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
116382024-11-27T18:44:32.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
116392024-11-27T18:44:32.837ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
116402024-11-27T18:44:32.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
116412024-11-27T18:44:32.867ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116422024-11-27T18:44:32.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
116432024-11-27T18:44:32.869ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
116442024-11-27T18:44:32.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
116452024-11-27T18:44:32.877ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 46.774773ms iteration = 24 status = {"physical_disks_added":0}
116462024-11-27T18:44:36.342ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:45946
116472024-11-27T18:44:36.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45946 req_id = e125140f-2a26-458e-a981-37b70120886b roles = RoleSet { roles: {} } uri = /metrics/producers
116482024-11-27T18:44:36.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45946 req_id = e125140f-2a26-458e-a981-37b70120886b resource = Database result = Ok(()) uri = /metrics/producers
116492024-11-27T18:44:36.379ZINFOnexus: assigned collector to new producer collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:76 producer_id = 89a52276-2829-4963-a094-8143be2c1bad
116502024-11-27T18:44:36.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36633 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45946 req_id = e125140f-2a26-458e-a981-37b70120886b response_code = 201 uri = /metrics/producers
116512024-11-27T18:44:38.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1032 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = 598bdfa7-43ec-4678-ac93-e321d6e84860 response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
116522024-11-27T18:44:40.277ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:60502
116532024-11-27T18:44:40.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:60502 req_id = 81eb4ace-340d-48b9-a4ca-429a60b9907a roles = RoleSet { roles: {} } uri = /metrics/producers
116542024-11-27T18:44:40.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:60502 req_id = 81eb4ace-340d-48b9-a4ca-429a60b9907a resource = Database result = Ok(()) uri = /metrics/producers
116552024-11-27T18:44:40.320ZINFOnexus: assigned collector to new producer collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:76 producer_id = b903b497-e034-4c1d-8f82-b6e6cc8f7a53
116562024-11-27T18:44:40.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43675 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:60502 req_id = 81eb4ace-340d-48b9-a4ca-429a60b9907a response_code = 201 uri = /metrics/producers
116572024-11-27T18:44:41.577ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
116582024-11-27T18:44:41.577ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
116592024-11-27T18:44:41.577ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116602024-11-27T18:44:41.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116612024-11-27T18:44:41.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116622024-11-27T18:44:41.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116632024-11-27T18:44:41.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116642024-11-27T18:44:41.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
116652024-11-27T18:44:41.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116662024-11-27T18:44:41.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116672024-11-27T18:44:41.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116682024-11-27T18:44:41.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116692024-11-27T18:44:41.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116702024-11-27T18:44:41.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
116712024-11-27T18:44:41.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116722024-11-27T18:44:41.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116732024-11-27T18:44:41.600ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
116742024-11-27T18:44:41.600ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.61304ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
116752024-11-27T18:44:41.612ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116762024-11-27T18:44:41.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116772024-11-27T18:44:41.614ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.198642ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
116782024-11-27T18:44:43.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 0256eee5-c11f-4f61-9c82-53f4eae8966d roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
116792024-11-27T18:44:43.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 0256eee5-c11f-4f61-9c82-53f4eae8966d resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
116802024-11-27T18:44:43.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3213 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = 0256eee5-c11f-4f61-9c82-53f4eae8966d response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?sort_by=id_ascending
116812024-11-27T18:44:43.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = aa072c93-c533-42fd-b07d-29962edad074 roles = RoleSet { roles: {} } uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
116822024-11-27T18:44:43.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = aa072c93-c533-42fd-b07d-29962edad074 resource = Database result = Ok(()) uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
116832024-11-27T18:44:43.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2327 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48635 req_id = aa072c93-c533-42fd-b07d-29962edad074 response_code = 200 uri = /metrics/collectors/dcc35444-727b-470c-aea4-6dbe99b74a25/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmM5NWIyOS1mODNkLTQzZWQtOTFmNC1jNjRkNDlkMjc5NGEifX0%3D
116842024-11-27T18:44:45.127ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
116852024-11-27T18:44:45.127ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
116862024-11-27T18:44:45.159ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
116872024-11-27T18:44:45.159ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:41627
116882024-11-27T18:44:45.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:41627 req_id = eb2532a5-ed2f-42d7-b9c5-3819f97760e8 roles = RoleSet { roles: {} } uri = /metrics/producers
116892024-11-27T18:44:45.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:41627 req_id = eb2532a5-ed2f-42d7-b9c5-3819f97760e8 resource = Database result = Ok(()) uri = /metrics/producers
116902024-11-27T18:44:45.185ZINFOnexus: assigned collector to new producer collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:76 producer_id = 028a6b4a-281e-48cb-ac6a-4e4dfed5a146
116912024-11-27T18:44:45.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26362 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:41627 req_id = eb2532a5-ed2f-42d7-b9c5-3819f97760e8 response_code = 201 uri = /metrics/producers
116922024-11-27T18:44:45.185ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "eb2532a5-ed2f-42d7-b9c5-3819f97760e8", "content-length": "41", "date": "Wed, 27 Nov 2024 18:44:45 GMT"} })
116932024-11-27T18:44:45.187ZDEBGnexus (producer-registration-task): registered with nexus successfully
116942024-11-27T18:44:45.187ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
116952024-11-27T18:44:48.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1451 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = f16f025c-d892-4468-bc5e-5349e5b86b4d response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146
116962024-11-27T18:44:51.576ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
116972024-11-27T18:44:51.577ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
116982024-11-27T18:44:51.577ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116992024-11-27T18:44:51.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117002024-11-27T18:44:51.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117012024-11-27T18:44:51.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117022024-11-27T18:44:51.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117032024-11-27T18:44:51.579ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117042024-11-27T18:44:51.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117052024-11-27T18:44:51.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
117062024-11-27T18:44:51.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117072024-11-27T18:44:51.581ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.481676ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
117082024-11-27T18:44:51.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117092024-11-27T18:44:51.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117102024-11-27T18:44:51.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117112024-11-27T18:44:51.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117122024-11-27T18:44:51.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4ce244bc-1034-4855-877d-76a08bc15b71, lookup_type: ById(4ce244bc-1034-4855-877d-76a08bc15b71) } result = Ok(())
117132024-11-27T18:44:51.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117142024-11-27T18:44:51.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117152024-11-27T18:44:51.595ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 original_time_created = 2024-11-27 18:34:24.328871 UTC target_id = 4ce244bc-1034-4855-877d-76a08bc15b71 time_created = 2024-11-27 18:34:24.328871 UTC
117162024-11-27T18:44:51.595ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.529354ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4ce244bc-1034-4855-877d-76a08bc15b71","time_created":"2024-11-27T18:34:24.328871Z"}
117172024-11-27T18:44:54.222ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:37528
117182024-11-27T18:44:54.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37528 req_id = 60b3a1ce-680d-4e22-a273-eccce282f71f roles = RoleSet { roles: {} } uri = /metrics/producers
117192024-11-27T18:44:54.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37528 req_id = 60b3a1ce-680d-4e22-a273-eccce282f71f resource = Database result = Ok(()) uri = /metrics/producers
117202024-11-27T18:44:54.259ZINFOnexus: assigned collector to new producer collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:76 producer_id = 761834fc-a72f-4e26-9e1f-c4047ccf5da9
117212024-11-27T18:44:54.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36572 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37528 req_id = 60b3a1ce-680d-4e22-a273-eccce282f71f response_code = 201 uri = /metrics/producers
117222024-11-27T18:44:57.210ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:64026
117232024-11-27T18:44:57.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64026 req_id = 3bb71a0d-91d3-453f-a1ad-9964299e548d roles = RoleSet { roles: {} } uri = /metrics/producers
117242024-11-27T18:44:57.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64026 req_id = 3bb71a0d-91d3-453f-a1ad-9964299e548d resource = Database result = Ok(()) uri = /metrics/producers
117252024-11-27T18:44:57.247ZINFOnexus: assigned collector to new producer collector_id = dcc35444-727b-470c-aea4-6dbe99b74a25 file = nexus/src/app/oximeter.rs:76 producer_id = f3f7f234-938f-4eb4-84cd-9acd73e59924
117262024-11-27T18:44:57.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37155 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64026 req_id = 3bb71a0d-91d3-453f-a1ad-9964299e548d response_code = 201 uri = /metrics/producers
117272024-11-27T18:44:58.744ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1046 local_addr = [fd00:1122:3344:101::c]:33512 method = GET remote_addr = [fd00:1122:3344:101::d]:47845 req_id = b64e9682-f50d-4f36-9528-b27a2f776159 response_code = 200 uri = /028a6b4a-281e-48cb-ac6a-4e4dfed5a146